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descriptors- *INSTRUCTI0NAL design, instructional IMPROVEMENT, 
♦aptitude, cognitive At.LlTYr ♦INSTRUCTIONAL MATERIALS, 
TEACHING METHODS, LEARNING DIFFICULTIES, ♦LEARNING THEORIES, 
♦individualized programs, academic ACHIEVEMENT, MATERIAL 

development, redundancy, set theory, chemistry instruction, 

CONCEPT TEACHING, VOCABULARY DEVELOPMENT, MATHEMATICS 
INSTRUCTION, AUDIOVISUAL AIDS, TALLAHASSEE, FLORIDA 

AN exploratory STUDY WAS CONDUCTED ON THE INTERACTION 
BETWEEN COGNITIVE APTITUDES AND VARIED INSTRUCTIONAL 
TREATMENTS (TEACHING MATERIALS AND TEACHER METHODS) TO 

determine if learning difficulties could be significantly 

MINIMIZED BY ALTERING THE CONTENT OF INSTRUCTIONAL TREATMENTS 
TO fit the COGNITIVE APTITUDE PATTERNS OF INDIVIDUAL 
LEARNERS. THE AUTHORS SUGGESTED THAT ACHIEVEMENT OF THE 
STUDENT WOULD BE DIRECTLY RELATES TO THE CONGRUENCE BETWEEN 
HIS PATTERN OF APTITUDES AND THE “FORM OF CONTENT" OF THE 

material to be learned, to substantiate THIS contention, a 

PROGRAM OF HIGHLY SIMPLIFIED STUDIES WAS STRUCTURED AND 

conducted, seven series of studies were undertaken among 

DIFFERENT GRADE LEVELS— (1) "FORM OF CONTENT" VARIABLES IN 
EXISTING textual MATERIALS WERE IDENTIFIED, (2) REDUNDANCY AS 
A “FORM OF content" VARIABLE WAS EXAMINED, INCLUDING 

redundancy levels and cognitive aptitudes related to 

REDUNDANCY, (3) MATERIALS ON SET THEORY CONCEPTS WERE 
DEVELOPED AND TAUGHT, EMPHASIZING THE APTITUDE COMBINATIONS 
OF verbal-deductive, VERBAL- INDUCTIVE, FIGURAL-DEDuCTIVE, AND 
FIGURAL-INDUCTIVE, (4) ACHIEVEMENT OF STUDENTS IN CHEMISTRY 
WAS RELATED TO SIMILARITIES OF TEACHER AND STUDENT APTITUDE 
patterns when general ability was HELD CONSTANT, (5) 
PERFORMANCE ON VERBAL AND FIGURAL CONCEPT ATTAINMENT TASKS, 
presented By either COMPUTER-ASSISTED INSTRUCTION OR BY A 
HUMAN EXPERIMENTOR, WAS RELATED TO APTITUDE VARIABLES 
BELIEVED TO BE RELEVANT TO THE TASKS, (6) INTERACTIONS OF 
aptitude and INSTRUCTION IN VOCABULARY LEARNING WERE STUDIED, 
AND (7) the effects OF SYMBOLIC AND SEMANTIC CONTENT ON THE 
LEARNING OF MATHEMATICAL OPERATIONS WERE ANALYZED. RESULTS OF 
THESE STUDIES DEMONSTRATED THE FEASIBILITY OF CONTROLLING 
aptitude-instruction INTERACTIONS TO ENHANCE LEARNING IN A 
VARIETY OF subject-matter AREAS AND AT DIFFERENT AGE AND 

Grade levels, related information may be found in ed did 62b. 
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PREFACE 



The contents of this report are the results of 
exploratory studies of aptitude treatment interactions 
as they might occur in public school instructional 
situations. 

About three years ago several of us began mutual 
discussions of the possibility that different cognitive 
aptitudes might be elicited by different sets of instruc- 
tional materials and that these aptitudes might also be 
differentially elicited by different instructional methods. 
To some extent these opinions arose from comments by under- 
graduate students who, when receiving academic counseling, 
would comment "Professor Jones teaches the way I learn, 
so I want to get in his section again." Also, these 
opinions were based on the implicit implications of 
perplexingly different comments by students who were 
experiencing difficulty in class and would express their 
difficulty as ”I can't see it,” "I don't get the feel of 
it," which seem to suggest a preferred mode of gaining 
understanding. These opinions were also supported by 
observations by instructors who used different approaches 
in an elementary statistic course, e.g., logical develop- 
ment and geometric explanations, when teaching bivariate 
correlation. They observed that only some students 
profited from a particular explanation whereas others 
profited from an alternate explanation of the concept. 
Finally, cur examination of graded textbooks for the 
elementary school led us to believe that items in the 
series were relatively constant with regard to objectives 
but differed with regard to the degree of verbal aptitude 
which was needed to cope with them. 

The joint effect of these opinions and observations 
caused us to infer tentatively that different instructional 
materials and teaching methods— separately and, quite 
likely, jointly— cater to some leame:&s and not others on 
the basis of the aptitudes which these require for learning 
from them. The observation about graded textbooks led 
inevitably to wondering whether instructional materials 
could be written which would differ from each other with 
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respect to the several aptitudes which they would require 
in order to profit from them, instead of differing almost 
solely on verbal load. 

This rather loose rationale was <^fs®I**sed ^ us 
and our view of it matured so that it took this xoxtu; 
Learning, at least In part, is a result of the interaction 
of learner aptitudes and variables which are unwittingly 
embedded in or unavoidably part of textual materials and 
teaching behavior. Further refinement led to this propo- 
sition: Learning will be optimized when Instructional 

materials and teaching behavior call into the learning 
situation the most highly developed aptitudes of the 
students . 

Our Interest in this notion arose from or was 
stimulated by certain beliefs and facts. First, If such 
a conception were empirically valid, then it would be a 
potentially powerful theory with which to guide the 
educational diagnosis of learning difficulties. Second, 

It would provide at least a theoretical basis on which 
to hold that any student Is potentially capable of 
learning any content, a view held by many today but 
without noticeable empirical or theoretical support. 

Third, it enabled us to understand the student comments 
about their preference for Instructors and their learning 
difficulties. Fourth, because all of us were in some 
manner involved in research on computer-assisted 
instruction, it appeared to be the first-step toward 
that remote point at which a computer might be programmed 
to prepare a unique set of instructional materials for 
each student on the basis of his pattern of aptitudes. 

Planning an empirical investigation of the 
general hypothesis confronted us with the need to m^e 
decisions about certain critical questions as a prelude 
to structuring any progp^am of studies at all. These 
decisions were made for good or ill and determined the 
particular kinds of studies which were undertaken. Some 
of these choice-points and the decision made about each 
of them are discussed here simply because other researchers 
might wish to make contrary choices so that eventually 
the results of all studies might be complementary • First , 
aptitude has several meanings and falls In several domains 
of behavior. We choose to regard aptitude as a learned 
behavior which explains transfer in learning situations. 
Also, we narrowed our interest to cognitive aptitude, 
although recognising the existence and potential 
ing>ortance of psychomotor and attltudinal aptitudes. 
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This latter cholcfe was based on personal preference 
of the Investigators* their belief that our understanding 
of cognitive aptitude is more advanced than is our grasp 
of other aptitudes, the availability of more instruments 
for assessing cognitive aptitudes than other aptitudes, 
and that cognitive aptitudes have greater 
relevance from the standpoint of their amena*/**xuy to 
manipulation than do the others. Second, we recognized 
that the study of this topic would be long-te^ and t«at 
several entry points were feasible when Judged in 
of potential educational significance. One might launch 
studies to alter experimentally the aptitude levels of 
students,, thereby shaping the students to fit 
nrevaillng of possibly other more economical teaching 
methods and materlala . One might launch frontal 
of the interaction of aptitude and instiMictlon. We chose 
the latter but continued to be divided «^»ong 
about which avenue is more Important, ''f firmly 

decided at the outset to conduct studies which had 
educational "face-validity;” i.e., we wished tJO avoid 
laboratory-studies the conditions and results of which 
would be difficult to replicate in or generalize to 
practical educational situations. The reader will 
eventually note that the complexity and . 

pertinent variables eventually drove us into the 
tory despite our wish to avoid it. Fourth, we decided 

to capitalize on existing textual 
methods. The former would be analyzed for hitherto 
unidentified variables, which we called form of content 
variables* and the latter would be subjected to analyses 
which were similar in purpose, pje reader 
subsequently that this decision had to 5®^®^®”^®*^?®. . ^ 
because of the unsuspected complexity of both variables 
(or, perhaps* the conspicuous limitations of the inves- 
tigators) and our logistical inability to study them in 
natural situations. Consequently, the majority oi 
studies reported here are highly simplified ®”^ 
are based on materials which we specifically constructed 

for the purpose. 
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INTRODUCTION 










I. 



A considerable body of knowledge about differences 
in human abilities has been produced by differential 
psychologists and psychometricians. Experimental psy- 
chologists conducted studies that led to formulating 
rough outlines of learning theories based on the average 
performance of groups of subjects. The readiness of 
experimentalists to consider the performance of individual 
subjects has contributed to the current interest in 
merging these two fields, individual differences and 
learning theory. In a recent symposium (26), several 
psychologists addressed themselves to the task of 
accomplishing such a merger. Consideration of the 
parameters of learning, as they apply to Individual 
patterns of abilities, will surely influence the develop- 
ment of curriculum materials and teaching methods in a 
memner that will cause them to be more efficient than 
those now In use. 

In a paper, "How Can Instruction Be Adapted to 
Individual Differences?”, Cronbach (13) discussed how 
Instruction has been adapted to individual differences. 

He suggested that the most adequate way of coping with 
individual differences in the school might be to alter 
instructional methods to fit the aptitude pattern of 
the learner. This procedure would not be useful unless 
an aptitude treatment Interaction exists; i.e., students 
high in a given ability achieve better under one method 
of instruction than they do under .another. Ideally, 
there should be a general theory that would specify the 
conditions of instruction which are optimal for students 
of certain ability types so that adapting instructional 
methods to individual differences can be accomDlished 
systematically. 

The general purpose of the research reported 
herein was to be achieved by completing a three-part 
sequence of activities: (a) to Identify and define 

operationally dimensions of an hypothesized variable, 
tentatively called "form of content,” which is described 
subsequently and is believed to be present in all 
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t;extual materials; (b) to prepare several sets of 
Instructional materials, each member of each set having 
an unique and known value on a dimension of the form 
of content variable and all members of a set leading 
to achievement of the same behavioral outcome; and 
(c) to determine whether students who use these materials 
achieve mastery levels that are predictable on the 
basis of the congruence of the particular value of the 
form of content variable and the students* cognitive 
aptitudes. 

The importance of the problem arises from the 
centrality of the form of content variable to the 
following conception of the teaching— learning process. 

activity (c, above) is based upon the postulate 
that form of content is a mediating variable in the 
learning process • Its interaction with the cognitive 
aptitudes which the student brings to the learning 
situation determines his attained level of achievement. 

It is hypothesized that each variation of form of 
content can be described in terms of the cognitive 
aptitudes that are associated with maximal achievement 
of the content in which it is embedded. Consequently, 
it is hypothesized that student achievement will be 
directly related to the congruence between his pattern 
of aptitudes and the form of content of the material 
to be learned. 

Form of content undoubtedly has many dimensions 
or facets and concerted study of it will probably cause 
Ip oo b6 partitioned Into several variables# A super- 
ficial consideration of instructional materials reveals 
features , each of which probably facilitates or impedes 
learning, depending on particular aptitudes of the student. 
For example, most textual materials place great stress 
on verbal facility; however, some of these might be recast 
so that the verbal loading is minimized or another 
feature (hopefully related to an aptitude) is emphasized. 
Thus, it is conceivable to have two geometry textbooks, 
one of which places a premium on verbal ability and the 
other on spatial ability. The development of topics 
in some textual materials proceeds inductively, whereas 
in others it progresses deductively. Both kinds of 
reasoning have been recognized as cognitive abilities 
and measured for some time by Psychological test 
specialists. Instructional materials in history might 
be organized chronologically or topically. Little is 
known about the differential appeal of such variant 
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organizations of content* Another dimension might be the 
particular mode of presenting a concept, e.g., does the 
author of an elementary statistics book when developing 
uhe concept of correlation do so by illustrating geomet- 
rically that it is the cosine of two angles formed by 
test vectors, or by illustrating that it is ratio of 
shared variation to total variation where each is 
represented by symbols describing operations on scores, 
or by illustrating nonmat hematlcally that it is the 
proportion of behavioral elements common to both measures. 

The remainder of Volume I of the report is 
organized as follows: First a review of pertinent 

literature is presented. The next seven sections contain 
studies which were done during the project. The last 
three sections contain a general discussion of problems 
encountered in the research studies; conclusions, 
recommendations, and implications; and a general summary. 
Volume II consists of appendices which contain all of 
the experimental versions of instructional materials which 
were produced during the project. These materials repre- 
sent a substcfiitial Investment of time and energy and are 
included for whatever advantage they might give to other 
researchers . 
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II. REVIEW OP LITERATURE 



ihs puz*pos6 of* l^hls soct^lon is to pz*GS6nt 8 l review 
of selected papers and studies that deal directly, theo- 
retlcally or empirically, with aptitude treatment inter- 
actions (ATI), and that are directly applicable to the 
studies executed in the present project. Theoretical 

papers are reviewed first and then empirical studies are 
reviewed . 



A. Theoretical Papers 
Guilford and Hoepfner 

Guilford’s Structure of Intellect model (28) is 
basic to much of the research in this i*eport. In general, 
the model can be described as a representation of an 
information processing system having several dimensions. 

In its present form, the model is three-dimensional; 
the dimensions being "operations,” "content,” and "prod- 
ucts. The operation dimension is similar to the more 
traditional constructs of mental acts or thoughts. The 
content dimension is related to observable stimulus 
elements. The product dimension seems to be best 
described as particular kinds of observable responses. 

The operation, content, and product dimensions respectively 
contain five, four and six categories each. The defini- 
tion of each dimension and its categories follows: 



OPERATIONS 

Major kinds of intellectual activities or proc- 
esses; things that the organism does with the 
raw materials of information, information being 
defined as "that which the organism discriminates. 

Cognition. Immediate discovery, awareness, 
rediscovery, or recognition of information in 
various forms; comprehension or understanding. 

Memory . Retention or storage, with some degree 
of availability, of information in the same 
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form it was committed to storage and In response 
to the same cues In connection with which It was 
learned • 
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^ uenerax^ion of information 

from given information, where the emphasis is 
upon variety and quantity of output from the 
same source. Likely to Involve what has been 
called transfer. This operation is most clearly 
involved in aptitudes of creative potential. 

Convergent Production . Generation of information 
from given information, where the emphasis is 
upon achieving unique or conventionally accepted 
best outcomes. It is likely the given (cue) 
Information fully determines the response. 

Evaluation. Reaching decisions or making Judgments 
concerning criterion satisfaction (correctness, 
suitability, adequacy, desirability, etc.) of 
Information. 

CONTENTS 

Broad classes or types of information discrlmi. 
nable by the organism. 

gigural . Information in concrete form, as 
perceived or as recalled possibly in the form 
of images. The term "figural" minimally implies 
figure-ground perceptual organization. Visual 
spatial information is flgural. Different 
sense modalities may be Involved, e.g., visual, 
kinesthetic. 

Symbolic . Information in the form of denotative 
signs, having no significance in and of them- 
selves, such as letters, numbers, musical 
notations, codes, and words, when meanings 
and form are not considered. 

Semantic. Information in the form of meanings 
to which words commonly become attached, hence 
most notable in verbal thinking and in verbal 
communication but not identical with words. 

Meaningful pictures also often convey semantic 
information. 

Behavioral . Information, essentially non-verbal, 
involved in human interactions where the attitudes. 
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d68lx*689 woods, Int^H^loDs^ porc^p talons 9 
thoughts, etc., of other people and of ourselves 
are Involved. 

PRnnirn«PQ 

Ponns that Information takes in the organism’s 
processing of it. 

Units . Relatively segregated or circumscribed 
items of infoz*isation having ”thlng” character. 

May be close to Gestalt psychology's "figure on 
a ground." 

C lasses . Conceptions underlying sets of items 
of information grouped by virtue of their common 
properties . 

Relations . Connections between items of Inf^jnna- 
tlon based upon variables or points of contact 
that apply to chem. Relational connections are 
more meaningful and definable than implications. 

Systems . Organized or structure:^ aggregates of 
items of information; complexes of Interrelated 
or interacting parts. 

transformations . Cheiiges of various kinds 
(redefinition, shifts, or modification) of 
existing InfoKaation or in its function. 

Implic ations . Extrapolations of Information, in 
the form of expectancies, predictions, known or 
suspected antecedents, concomitants, or conse- 
quences. The connection between the given 
Information and that extrapolated is more general 
^d less definable than a relational connection 

(28, pp. 3-^). 



Ferguson 

Ferguson (16, 17 ) attempted to Include human 
learning and human ability in a single theory » noJLlity 
was defined as the performance of an individual in a 
specified situation whereas learning refers to changes, 
with repetition, in ability to perform a specified task. 
Ferguson suggested that conventional learning curves are 
simply descriptions of changes in abilities with 
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repetition. Abilities reach crude stable limits in the 
adult population and are therefore considered to be over- 
learned acquisitions. Transfer of training is considered 
to be the general case with learning being a special 
aspect of it, Ferguson pointed out, in hypothesis form, 
that abilities exert their effects differentially in any 
learning situation; that different abilities exert 
different effects at different stages of learning and that 
the abilities which transfer and produce their effect at 
one stage of learning might be different from those which 
transfer and produce their effects at another stage. 



Gagne 

The two quotations from Gagne^ which appear below 
deal with ATI in a specific instructional area. 

• • . it should be possible to verify a number of 
hypotheses, not only about the nature of abilities 
involved in mathematics but also about the essential 
nature of what is learned in mathematics, such as: 

1. People who are high in spatial ability should 
acquire mediating spatial concepts more 
readily than they do symbolic or verbal ones. 
This should also be true for numerical 
ability and verbal ability. 

2. People who are high in verbal ability should 
reveal a better performance on geometric 
problems when they are taught verbal media- 
tors than when they are taught spatial or 
symbolic ones. Similar statements could be 
made for the other basic abilities, spatial 
and numerical, using algebraic and formal 
logic problems as performance criteria. 

3* Vfhen people high in spatial ability are taught 
the same mathematical principle in terms of 
spatial, verbal, and symbolic concepts, meas- 
uring retention of this pr5.nclple after a 
period of time should reveal increasing 
dependence on spatial concepts. Again, similar 
hypotheses could be made to pertain to the 
other abilities (23, p. 53). 

Gagne' also proposed a research design for the study of 
a specific problem. His statement of the ’‘problem” encap- 
sules the general concerns of the present investigators. 
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Differences In fundamental abilities appear to 
be prominent in the learning of mathematics, as well 
as in the way people use mathematical concepts. 
Well-established factors in human abilities are 
spatial, numerical, and verbal. Although there are 
studies which have revealed moderate to high corre- 
lations between aptitude measures and grades in 
mathematics, no studies have been conducted in the 
attempt to make specific predictions concerning 
the facilitation of different kinds of conceptual 
learning by different fundamental abilities. i‘he 
possession of a high degree of spatial ability should 
facilitate the learning of spatial concepts; high 
verbal ability should facilitate the learning of 
verbal concepts; and high numerical ability should 
facilitate the learning of symbolic concepts. 

The learning of concepts of addition of directed 
numbers may be done verbally, spatially, or symboli- 
cally. Verbal rales are perhaps the best known 
method, occurring in most conventional textbooks. 
Spatial concepts have been used with considerable 
success, notably in the textbook of the University 
of Illinois Committee on School Mathematics. 

Symbolic concepts can readily be designed to serve 
the same purpose; in one form, they might resemble 
some of the symbolism of boolean algebra. Thus 
in this mathematical topic, the opportunity exists 
of relating differences in fundamental abilities 
tc ease of learning the different types of concepts, 
as well as to final performance in problem solving 
(24, p. 112). 

The references cited above, together with the 
work of Cronbach referred to earlier, provide strong 
support for the present series of studies. The conceptual 
framework provided by the structure of Intellect for 
the classifications of both Individual aptitudes and 
task variables was of much value in planning and executing 
several studies. The general theoretical formulations 
of Ferguson and the specific concerns of Gagne' aided 
in the formation of the Investigators* ideas about ATI 
and gave support to their conviction that the area was 
an Important one to Investigate. 



B. Empirical Papers 

Empirical studies which show some support for ATI 
are presented next. 
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Dunham, Guilford, and Hoepfner 

Dunham, Guilford, and Hoepfner (1^) investigated 
the relationships of abilities of the ’’class” by ’’content 
cells’* of the SI model and concept learnings Aptitude 
tests measuring fifteen of Guilford’s factors were 
administered to a group of 177 junior and senior high 
school students. Three concept-learning tasks utilizing 
the same type of content (symbolic, flgural, and semantic) 
were given to all students* Ninety-six examples were 
given for each of the three types of concept problems 
and were administered in twelve trials (practice stages) 
of eight examples each, 

4 

The two principal dependent variables were the 
number of correct responses per trial and the number of 
correctly verbalized concepts for each task. The 
results (in terms of factor loadings greater than .30) 
indicated that the divergent production of symbolic 
classes and the memory of symbolic class factors were 
significantly related to certain practice stages in the 
symbolic-concept learning task. Memory of symbolic 
classes was significantly related to performances on 
the flgural concept task, and the memory of semantic 
classes, memory of symbolic classes and convergent 
production of semantic class factors were important in 
the semantic-concept learning task. Also, they found that 
the factor of cognition of semantic classes was strongly 
related to the verbalization scores in the semantic and 
flgural concept learning tasks. 



Gagne and Paradise 

Gagne'^and Paradise (25) reported a study of the 
Interactions of cognitive variables with achievement 
when teaching strategy was held constant. Their purpose 
was to investigate a theory that knowledge of a particular 
content can be divided into an hierarchical series of 
learning sets. The theory postulates that attainment of 
any given learning set is dependent on recall ability of 
subordinate learning sets, instructions defining a new 
task, and the integration by the learner of subordinate 
learning sets into the solution of the new task. The 
authors suggested that any learning task can be analyzed 
into subordinate learning tasks. These subordinate tasks 
can be analyzed in turn. The analytic procedure can be 
continued until a basic set of necessary cognitive 
abilities is defined as the lowest level of. the hierarchy. 
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They analyzed an algebra task (solving equations) Into 
an hierarchical structure of learning tasks. They 
determined that the basic cognitive abilities necessary 
to learn the task were number (arithmetic operations), 
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tion (picture-number associative memory). Measures of 
these abilities were obtained on 118 seventh-graders 
by administering one test for each ability. The subjects 
were taught the algebra task by a programmed textbook. 
Analyses of the data revealed that the correlations 
between the three relevant abilities — number. Integration, 
and symbol recognition— and final performance were higher 
than were correlations between final performance and 
abilities Judged to be irrelevant (vocabulary and speed 
of symbol discrimination) . Correlations between the 
three relevant abilities and rate of attainment decreased 
progressively as learning progressed through the hierarchy 
of learning sets, whereas correlations between irrelevant 
variables and rate of attainment remained nearly cortstant. 
Correlations between number and symbol recognition and 
achievement of learning sets increased as level 
Increased, whereas correlations between irrelevant 
variables and achievement of learning sets did not. 

The results of the Gagne^and Paradise study present 
a strong argument for the thesis that a particular set 
of abilities Is Important In a given learning task. The 
Investigators did not discuss the problem of teaching 
students who were weak In any of the three basic abilities. 



Blade and Watson 

Blade and Watson (4) reported that engineering 
students increased their scores on the CEEB Spatial 
Relations Test by nearly one standard deviation and 
nonenglneerlnc students Increased by only one-half 
standard deviation during their freshman year In college. 
Engineering students In one Institution (N » 89) were 
studied Intensively with regard to these gains. Previous 
courses In mechanical drawing, mechanical hoboles and 
relevant work experience were related to high Initial 
spatial score. Spatial ability was positively correlated 
with grades in both descriptive geometry and engineering 
drawing. Low Initial ability students who later graduated 
made the largest gains (M « 20.55 points), those who did 
not graduate made smaller gains (M « 12.90 points). The 
authors suggested that It might be of value to teach 
drawing and descriptive geometry In a more concrete way 
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for students of low (undeveloped) spatial ability whereas 
a more theoretical approach would be profitable for 
students of high ability. 



Snow, Tiffin, and Seibert 



In an investigation by Snow, Tiffin, and Seibert 
(39) learner-variable by teaching method interactions 
were studied. Two sections of introductory college 
physics classes at Purdue University totaling ^137 students 
were divided between filmed and live physics lecture 
demonstrations. Nineteen short films organized into 14 
classroom presentations demonstrating specific physics 
principles were given to one group while the other group 
received the parallel live teacher demonstration of the 
same principal. Immediate recall criteria comprised of 
short tests following each lecture along with delayed 
recall criteria comprised of questions included In five 
hourly course examinations were used. Using a prior 
knowledge of physics and 14 other learner characteristics 
as independent variables, a series of 2 x 3 x 3 unweighted 
means analyses indicated that attitude toward instruc- 
tional films, ascendancy, responsibility, numerical 
aptitude, verbal aptitude, past experience with entertain- 
ment films, and past use of college library instructional 
films interacted significantly with instructional treat- 
ments (live versus filmed). This occurred primarily on 
the immediate recall criterion. Prior knowledge of physics 
modified most of these effects, however. Attitudes toward 
entertainment films and toward physics, emotional 
stability, sociability, total personality self-evaluation, 
academic achievement, and unspecified past experience 
with instructional films did not interact with treatments. 



Petersen, Guilford, Hoepfner, 
and Merrlfield 



The relationship between achievement in ninth- 
grade algebra and general mathematics and certain factors 
represented in the structure of intellect model was 
Investigated by Petersen, Guilford, Hoepfner and 
Merrlfield (37). Approximately 600 ninth-grade students 
in one of the Los Angeles County high schools served as 
subjects. Pour mathematics courses were involved, 

Basic Mathematics, Non-college Algebra, Regular Algebra, 
and Accelerated Algebra. The first two courses were 
listed as General Mathematics. Two achievement examina- 
tions, covering general mathematics and algebra, were 
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given at the end of the year’s work. Multiple-regression 
equations were computed, predicting examination achieve- 
ment and final course grade from a combination of 
standard tests and factor tests. The following general 
conclusions were drawn! 

(1) The higher the level of the mathematics course, 
the larger the number of factors that appear to 
be involved, from six in Basic Mathematics to 
ten in Accelerated Algebra. 

(2) The pattern of more predictive factors varies 
according to the course level, but certain 
factors are significantly related in different 
courses and certain systematic differences occur 
as between general mathematics and algebra in 
their present demands on the factors . 

(3) On the whole, con^josltes of standard academic- 
aptitude tests and composites of factor scores 
do about equally well in prediction, but for 
somewhat different factorial reasons , with some 
tendency for standard tests to do better in 
predicting in general mathematics and factor 
tests to do better in predicting in algebra. 

(4) When factor tests are added to each of the three 
standard-test combinations, multiple prediction 
increases significantly for algebra courses but 
not for general-mathematics courses. 
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(5) Grades and achievement- test scores are about 
equally predictable from either standard or 
factor tests, but the factor picture of course- 
grade criteria is usually inconsistent with that 
for achievement-test criteria, especially for 
general mathematics. 
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(6) Construct scoring, with detailed point systems 
along factorial lines, did not provide a total 
criterion that was any more predictable than the 
traditional scoring of one point for each problem 
correctly solved. 

(7) The problem of aptitude for success in ninth- 
grade mathematics is even more complex than was 
anticipated, and will require a broader sampling 
of the intellectual abilities before it is solved. 
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(8) A test battery that will yield a high level of 
prediction of mathematics achievement appears to 
be possible, when enough of the relevant factors 
are Included (37, p. 35). 

Most of the empirical studies cited In this sec- 
tion of the review used variations of curricula actually 
being used In classrooms as Instructional treatments. 

As a consequence the results of the studies, while 
supporting ATI, do not allow the Isolation of relevant 
aspects of the curricula which are responsible for the 
interactions. The present research Is Intended to help 
clarify the nature of these form of content variables 
by analyzing existing curriculum materials for them 
and by using the general procedures outlined by Dunham, 
Guilford, and Hoepfner (14) and by Gagne'and Paradise (25) 
for constructing treatments in which they can be varied. 
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III. FORM OP CONTENT VARIABLES 
IN TEXTUAL MATERIALS 



The purpose of this series of studies was to 
Identify form of content variables in existing text- 
books that might interact with student abilities In 
determining achievement. It was assumed that if these 
variables could be identified and operationally 
defined, then they might be deliberately taken Into 
account when writing textual materials. Thus, the 
resulting materials would have predetermined and known 
values on those variables which are believed to inter- 
act with learner aptitudes. Studies of the interaction 
hypotheses would be greatly facilitated If the investi- 
gator could control the elements In the material which 
are suspected to lend themselves to Interactive 
processes. 

Although there are instruments for identifying 
some of the abilities important in learning, no compa- 
rable ones exist for analyzing textual materials in 
terms of forms in which they might be cast. Therefore, 
these studies were concerned with the development of 
methodology as well as with the analysis of variables. 















I 



A. Identification of Variables; 

Analysis of Single Passages 

Purpose 

The two purposes of the study were to determine 
v/hether selected portions of textual material would be 
judged to depend more heavily on certain student abilities 
for their mastery than would other portions of the 
materials, and to attempt to Identify form of content 
variables that might facilitate or inhibit learning but 
do not seem to be directly related to mental abilities. 
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Method 

Subjects . Six graduate students in English education 
and nine graduate students in science education served 
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Procedure > The procedures for both groups of students 
were the same but different materials were T^sed with 
theme The science education student r analyzed portions 
of the reading passages from the Glaciers Test (36). 

Six sections of material were selected from the reading 
passage. These included three narrative paragraphs » 
one tab’r:*, one graph j and one figure. 

The English education students analyzed selected 
passages from Chapter 27 of the textbook. Biology (35) 
which treats Mendelian principles of heredity. Pour 
sections were selected from the chanter for intensive 
study. The first and third sections were paragraphs 
of written material, the second section contained 
three figures, and the fourth section was a table. 

Both groups were instructed to read the entire 
passage or chapter and then to attend specifically to 
the designated sections < Each student received a list 
of brief definitions of eight cognitive abilities from 
the ETS Kit of Reference Tests Manual . These were 
Deduction , Fle xibility of Closure > General Reasoning ^ 
Ideational Fluency . Ind uction, Number Facility, Semantic 
Redefinition , and Spatial Orientation . Below the 
statement of the definitions were blanks numbered to 
correspond to the selected passages in either the 
glaciers or biology material. Students were asked to 
list the mental abilities which they thought to be 
most importantly called into use when reading and 
understanding the selected passages. Also, students 
were asked to write in general or specific terms what 
they thought to be features of the materials that might 
facilitate or inhibit learning. 
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Results 

The numbers of times students thought certain 
abilities were needed to understand the selected passages 
appear In Table 3.11 for both groups. 
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TABLE 1 

Frequency with Which Abilities Were Judged Necessary 
for Mastering the Selected Passages 



Glaciers Material 



Tests 



Part of 
Passage 
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Paragraph 1 
Paragraph 2 
Paragraph 3 
Table 1 
Figure 1 
Figure 2 
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Biology Textbook Material 



Part of 
Passage 



Paragraph 1 
Figure 1 
Paragraph 2 
Table 1 
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A list of the facilitating or Inhibiting features 
of the Glaciers material Identified by the students 
appears below. It is followed by a similar list for 
Biology . 

\ 

Glaciers 

A. Tables and graphs should be located near textual 
referents. 

B« Understanding something depends on prior knowledge 
(e.g., relation between snowfall and climate). 

C. Extremely large numbers are not meaningful. 

D. Organization is poor; lacks subheadings or other 
organizational devices. 

E. Passage is too ”fact*’ oriented. 

P. Reading level (some words) may be Inappropriate 
for ninth- or tenth-grade students. 

6. Specific examples supporting major ideas are 
lacking. 

H. Passage needs general overview or statement of 
problem or topic. 

I. Transition from paragraph to paragraph is poor. 

J. Passage evokes little interest in students. 

K. Tables are hard to understand because of use of 
large numbers. 

Biology 

A. Use of questions 

1 . Introductory 

a. Can, and definitely should, be motivating. 

b. Should lead directly into discussion. 

2. Interspersed, to enable student to test his 
understanding. 

a. Have to be capable of being answered 
directly or indirectly from the material. 

b. Need verification of answers, preferably 
in subtle form. 
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Summary 

a. Should be provocative but answerable, 
bo Should be at different levels (e.g., from 
easy to difficult, or, preferably, same 
questions capable of being answered On 
different levels by students of varying 
sophistication) . 



Plcture-questlon-explanatlon sequence Is good. 



Leading student Into doing Is essential to both 
motivation and understanding. 



Illustration and some explanation before attaching 
terms leads to less confusion than does greater 
density of and earlier definition of terms. 



Informality of style is regarded as good. 



Subheadings in boldface type are useful for 
transition, organization and emphasis. 



The ’’What have you learned?" section is useful. 
Format 



1 . 

2 . 



Pictures are stimulating and informative. 



Text, especially questions, should be 
designed to be on same or facing pages 
with pictures, figures, or tables. 



Discussion 



The frequency with which students thought that 
different abilities were related to mastery of the 
materials exhibits some clear tendencies. First, 
deduction, flexibility of closure, and general reasoning 
are most frequently cited as necessary for understanding 
narrative materials, and to a lesser extent are cited 
for figure and table presentations. Second, ntimber 
facility and spatial ability are rated highly only 
when figure and table presentations are considered. 
Third, ideational fluency was mentioned rarely whether 
the presentations were narrations, figures, or tables. 



The features which subjects pointed out as 
facilitating or inhibiting understanding are quite 
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difficult to categorize meaningfully because few subjects 
designated the same aspects of the passages as faculta- 
tive or inhlbltlve. Consequently, it Is inescapable to 
wonder whether the features which were designated were 
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Student aptitude and an attribute of the passage. The 
fact that some students thought ’’tremsition from para- 
graph to paragraph is poor” and others thought that it 
was not poor actually suggests the presence of an inter- 
action between that feature of the material and the 
perceiver. But in addition to features which are apparent- 
ly related to cognitive aptitude, students did identify 
many features which they believed effected mastery but 
which were not cognitively related; e.g., questions 
should be provocative but answerable, ^leading students 
doing is essential to . . . motivation . . 
“informality of style is regarded as good,” and "pictures 
are stimulating • . The lack of consensus on these 
points and the actual occurrence of conflicting state- 
ments suggest that certain features of textual materials 
might Interact with affective attributes of students. 



B. Identification of Variables; 

Comparison of Equivalent Passages 

The purposes of this study were to determine 
whether maste^ of the same content presented in three 
different textbooks would be Judged to involve different 
abilities depending on the book used, and to identify 
other form of content vau?iables by contrasting the ways 
in which the same content was presented in the three 
books . 

In the preceding study students were asked to 
identify form of content variables by examining one set 
of materials. In the present study the same content 
in each of three textbooks was examined by each student. 
It was felt that form of content variables that existed 
at different levels in the three books might be more 
easily Identified through comparisons of the three 
selections than by examination of only one set of 
materials . 



Method 

Subjects . Ten graduate students in educational i--ychology 
classes wei»e used as subjects. 
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Materials » All students read selections on Mendelian 
principles of genetics from each of three high school 
biology textbooks. The books used and the pages read 
were as follows; 

(&) Bi ological Science: Molecules to Man C3s 

Biology (35, pp. ^11-^20) 

(c) Living Things (18, pp. 91-100) 

Each student was given a copy of the three text- 
books. Different orders of reading the selections were 
assigned. In addition, two mimeographed forms were given 
to each student. The first form contained these directions. 

Shown below is a list of 5 mental abilities. 

After you have read the passages, rank the books 
according to which would call for more of ability 
1 on the part of the reader. After finishing 
ability 1, then rank the books on the rest of the 
abilities. Rank them by title names. (1 ** most 
ability required) 

Definitions of Mental Abilities 

(a) Seduction— Ability to reason from stated premises 
to their necessary conclusions. 

1 __ 2 3 

(b) General Reasoning— »The ability to solve a broad 
range of" reasoning problems including those of 
a mathematical nature. 

1 2 3 

(c) Induction— The ability involved in the finding of 
general concepts that will fit sets of data, the 
forming and trying out of hypotheses. 

1 2 3 

(d) Number Facility— The ability to manipulate numbers 
in arithmetical operations rapidly. 




(e) Flexibility’ of Ciosure—’fhe ability to keep one 
oF'l!ori'^eflnI^e'’'oori^ in mind so as 

to make identification In spite of perceptual 
distractions. Tests of this ability require the 

W AM W Wii--- 

taining irrelevant or distracting material in 
order to find one or more given configurations. 
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The second form gave the following directions. 

*fou are asked to read the designated passages 
in the three books you have been given. Then on 
Page 1 rank the books <2 « high) according to their 
effectiveness in producing in students the ability 
to recall materials in the passages. Then identify 
features of the books that facilitate or inhibit 
this ability. Please be as specific as possible. 

If possible, pinpoint the sentences, paragraphs, 
etc., that contain the inhibiting or facilitating 
feature . 

Examples of this ability to recall would be 
contained in the following test items. 

(a) Define domineuit-recessive trait. 

(b) Pollen from tall garden pea plants was dusted on 
the pistils of short pea plants. One hundred 
peas resulting from this cross were planted the 
following year. All of the plants were tall. 
What genes for tallness did the two parent 
plants probably have? 



Tall Parent 



Short Parent 



On page 2 you are asked to rank the books and 
identify facilitating or inhibiting features in 
producing in students the ability to apply 
knowledge gained from the passage to new concrete 
situations. Again, please be as specific as 
possible. 

An example of an item that measures this ability 
might be as follows: 

1. In man albinism is due to a recessive gene 
(a); the gene for normal skin color (A) is 
dominant. Alblnla and Smudgia are neighboring 
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kingdoms* The ratio cf albinos to non- 
albinos Is about the same in both kingdoroo. 
The inhabitants of Albinla, Influenced by 
race propaganda, decide that the only true 

*?« inriA 4 c skin +iV»atf 

set out, by drastic decrees governing 
matings, to produce a pure albine population. 
The nationalists of Smadgla, on the other 
hand, favor only non-albinos and enact 
similar decrees aimed at producing a 100 
non-albino population. Which kingdom will 
arrive at its goal first? Explain. 



Results 

Each of the ranked items was analysed by a rank 
sum method developed by Dunn-Rankin (15) to determine 
the probability of subject agreement being due to chance. 
The results cf these analyses appear in Table 2. They 



TABLE 2 

Hank Sums and Results of Tests of Significance for 
Subject Agreement on Abilities Involved in 
Three Biology Textbookr* 



Ability 


BSCS 


Textbook 

Living 
Biology Things 
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Deduction 


13 


21 


26 


BS>LT 


General Reasoning 


10 


23.5 


26.5 


BS>0thers 


Induction 


14 


21 


25 


BS>LT 


Numerical Facility 


10 


23.5 


26.5 


BS>0thers 


Flexibility of Clcsure 


20 


16 




NS 


Recall 


13 


12 


17 


NS 


Application 


8 


13 


15 


NS 



*For the five cognitive abilities a difference 
in rank sums between textbooks of 11 Is significant at 
the .05 level. For recall and application only 7 and 
6 subjects respectively had complete data and a difference 
of 9 is required for significance at the *05 level. 
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indicfate that the BSCS material more heavily emphasizes 
deduction, general reasoning. Induction, and numerical 
facility than do one or both of the other te:ctbooks. 

The books apparently do not differ with regard ^to^ 
emphasis on flexibility of closure. Also, studenta did 
not perceive the books to differ among themselves with 
respect to facilitating recall or application of the 
material contained in them. 

Facilitating and Inhibiting features of the three 
books listed by the students are given below: 



BSCS - Recall 



Facilitating 



A. tables, graphs and charts are good 

B. headings draw attention to key ideas 

C. "self check” questions helpful 

D. heavy print, shaded rectangles and lines around 
exan^>les are good 

E. good explication of arithmetical processes 

P. excellent discussion of probability and how it 
relates to heredity 

G. progression from unknown to known 

H. good for advanced students 

Inhibiting 

A. material too difficult for lower level students 

B. too many facts 

C. not enough picture'’ 

D. too much informatlc.i on probability 

E. "self checks” are too limited 

P. some definitions need improvement 

G. material not motivating 

H. too math oriented 

I. lack of effective color 

J. questions are vocabulary oriented 



BSCS - Application 



Facilitating 



A. good for applying to peas 

B. arithmetical processes 

C. discussion of probability 

D. "self checks" 



23 



















iiijpiiiaiwiirjfiyyrwi 



1 

! 

I 

;l 

f 

i 

I 

I 

i 

I 

I 

I 

I 

I 

I 

I 

I 

I 



E. questions at chapter end are aimed at higher 
levels 

P. book geared to application 

Inhibiting 

A. too few questions 

B. not interest rousing 

C. "self checks’* limited 

D. no **why” questions 

E. sticks to peas 



Biology - Recall 



Facilitating 



A. good use of pictures 

B. "useful words” and "test yourself" sections 

C. good introduction 

D. print type good 

B. good beginning book for advanced student 
P. use of italics 

Inhibiting 

A. illustrations seem extrsuieous 

B. some headings are misleading 

C. summary not specific enough 

D. peas aren*t realistic 

E. pictures not directly related to text 
P. definitions not entirely clear 

G. poor layout 

Biology - Application 

Facilitating 

good overall explanation for peas and animals 
"problems to think about" section 
"test yourself" and "do it yourself" sections 
not too complicated 

Inhibiting 

some pictures not good 

too detailed without giving pause to reflect 



A. 

B. 

C. 

D. 



A. 

B. 



Living Things - Recall 

A. diagrams and illustrations are explicit 
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B. bold type for key words 

C . explanations clear 

D. good use of subheadings 

E. approach is direct and simple 
r. easy to read 

G. good for beginning studen;; 

H. illustrations easy to understand 

I. book motivating 

J. use of questions within the text Is good 

K. good color usage 

L. book not "hard looking” 

M. book allows for outside reading 

Inhibiting 

A. peas aren’t realistic 

B. lacks Information found in other texts 

C. not enough facts 

D . skimpy presentation 

E. rushed presentation 

F. good students not challenged 

Living Things - Application 

Facilitating 

A. "check your facts” section 

B. peas to people 

C. ”why” questions 

Inhibiting 

A. questions barely adequate 

B. too simple, no practice 

C. very little Mendel Theory 

D. presentation rushed 

E. too few questions 

F . no bibliography 

G. inadequate coverage of material 

H. coverage too superficial 



C . Summary 

The first activity of the project was to identify 
form of content variables that might Interact with 
student aptitudes and thereby determine learning level. 
The period tentatively allocated to this activity was to 
be a major portion of the entire project. The two 
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studies reported in this section of the report were the 
initial, and final, attempts at Identifying these 
variables. Both studies revealed a great variety of 
features of textual materials which students believed 
to inhibit or fscilitate learning: Sonie of these 

features, although important in their right, were of 
only tangential interest to the project. These features 
might be ascribed to poor composition of the book, such 
as placing the tables too far from the relevant text, 
or to unintended defects In the author’s presentation. 
The other features might be categorized as having a 
cognitive or affective base. The latter category of 
features was ignored because the investigator decided 
at the outset to be concerned only with features that 
might interact with cognitive attributes of students. 

The remaining features, which were numerous, were of 
primary interest. Analyses of them revealed that the 
majority were highly particular and did not constitute 
a good basis on which to mount empirical Investigations 
of ATI. As a consequence, the investigators chose to 
discontinue further studies directed to identifying 
fora of content variables. This decision was made with 
some reluctance but with the expectation that a greater 
payoff would be achieved by following another line of 
attack on the problem. Essentially, this task was to 
attempt to Identify empirically ATI effects in learning 
by students, classified according to aptitude, through 
exposure to parallel sets of materials which contain 
different known values of a particular form of content 
variable, embody clearly identified teaching strategies, 
or heavily reflect one or more aptitudes. The subse- 
quently reported studies of redundancy of Instructional 
materials, vocabulary learning, and mathematical opera- 
tions are examples, respectively, of the learning 
materials . 
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IV. REDUNDANCY AS A FORM OP C0M1ENT VARIABLE 



Introduction 

Readability or reading difficulty of textual 
material is one form of content variable which has been 
widely investigated o But it has not been studied in 
the context of the aptitude treatment interaction 
hypothesis. However, It seems evident that persons 
having low reading skill and verbal ability will be 
more successful in treatments that Involve materials 
of low reading difficulty rather than high reading 
difficulty; although it Is not as evident that persons 
having high verbal ability and reading skill will achieve 
best on treatments involving high reading difficulty. 

In addition to the expected Interaction of verbal 
ability with difficulty level of reading materials, it 
is possible that abilities other than verbal ability 
are involved in differential achievement under two 
levels of. reading difficulty. 

The four studies reported here deal with 
redundancy as measured by the cloze procedure. The 
purpose of the first study was to identify variables in 
textual material that determine its redundancy level. 
Knowledge of these variables might enable the construe^ 
tion of sets of material with known redundancy levels. 

The second study is an Investigation of relationships 
between a set of cognitive abilities and redundancy of 
materials from several contents. The third and fourth 
studies were intended to determine whether passages 
from graded-readers vary in redundancy and, if they do, 
whether evidence for the aptitude treatment interaction 
hypothesis might be found through use of them. 

The term *’ redundancy” is used here in a general 
sense to indicate the amount of sequential constraint 
or organization among the words In a passage and to 
denote the extent to which a given word of a passage is 
determined by context. If a word is deleted but is so 
completely determined that It can be restored, it is 
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considered to be redundant. l?he relative redundancy of 
the passages was estimated by the close procedure. 

Cloze scores for passages are derived by averaging the 
propox*tlon of words which sub;}ects can correctly restore 
to mutilated passages; e.g.» one in which every fifth 
word has been deleted. 

The cloze procedure > as do many other methods of 
assessing redundancy ^ provides an indirect estimate of 
the relative word redundancy of passages from the word 
restorations of Individuals. It was selected because 
more Information about Its reliability and validity Is 
available than for other techniques. 

It was postulated that achievement from exposure 
to redundant and nonredundant Instructional materials 
would be mediated by cognitive aptitudes. The studies 
which are presented here are necessary preliminaries to 
Investigating the hypothesized influence of cognitive 
aptitudes. 



A. Redundancy, Content Area 
and Sxpressional Style* 

The central problem treated in this study arose 
when the absence of guidelines for writing Instructional 
passages of known redundancy values was noted. The 
redundancy of passages is known to be related to their 
readability. In turn, the assessment of readability 
depends on style factors In the passage. Because one 
might write Instructional materials in different 
expressional styles while simultaneously preserving 
the original content, manipulating style appeared to be 
a logical means of varying redundancy if relatlonshl.ps 
between individual elements cf expressional style and 
redundancy could be determined. Thus, the specific 
task was to determine relationships between redundancy 
and individual elements of expressional style. 

The elements cf style which were studied had been 
identified previously by other researchers. These were: 



•Beard, J.Q. The Relation of Redundancy to 
Content Area and Expressional Style in Hij^ School Text- 
books. Unpublished doctoral dissertation;, Florida State 
University, 1966. 

28 



ERIC . . ... 










I ^ Wtifriri'r. 






^« tfkH i w i fit » W i> »n ig rB yftg< nn i >nrrrj ii r 







I 

s 

I 

I 

I 

I 



# 



monosyllable words, sentence length, first person pro- 
nouns, second person pronouns, third person pronouns, 
different words, complex sentences. Infinitive phrases, 
words beginning with ”1", and a measure of abstraction. 
Relationships between redundancy and the extent of use 
of each of these expresslonal elements were determined 
for sample Instructional passages. 

Previous research Indicated that the expresslonal 
style of materials might differ between subject matter 
content areas. Therefore the relationships between 
redundancy and style were determined separately for each 
of four content areas of biology, chemistry, American 
government, and world history as well as for the combined 
group of the four content areas. 



Method 
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Subjects . The subjects were 250 beginning tenth-grade 
students from a public school. This grade-level was 
chosen because students would have had relevant prior 
instruction in the four content areas but would not have 
studied any of the areas In depth. 

To ensure that the sample was representative of 
tenth-grade students, 50 students were selected from 
each of the Florida-based percentile ranges 1-19, 20-39 > 
40-59 » 60-79, and 80-99 on the verbal section of the 
School and College Ability Test (SCAT) which had been 
administered to the students one year earlier as part 
of the Florida State-wide Ninth-grade Testing Program. 
Each cloze test form was administered to equal numbers 
of students In each ability level. 

Materials . Textbooks were sampled from all comprehensive 
high school textbooks In print In the content areas of 
general biology, chemistry, world history, and American 
government. Programmed textbooks, pictorial books, 
workbooks, or other books in nonprose formats were 
eliminated from the list before the sample was chosen. 

A ’’comprehensive” textbook is one which deals with the 
whole content, and It stands in contrast to specialized 
books which are used as collateral texts. The procedures 
which were used to select the contents, textbooks, and 
passages, and to construct the cloze test forms are 
described below. 
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The four contents— biology , chemistry, world 
history, and American government— were arbitrarily 
chosen. Each meets the following criteria which were 
established as requisites for inclusion in the study: 

^a; The content must be generally taught in high schools 
throughout the United States; (b) The content must be 
so limited in scope that a single book Is usually used 
as a main text in the hl^ school level; (c) The content 
must be suitable for both boys and girls; and (d) Ten 
or more textbook titles must appear in Textbooks in 
Pi lnt 1965 C4lX for that content. (Thls^ Is necessary 
to provide the sample size required by the experimental 
design. ) 

Ten textbooks were randomly selected for each 
of the four contents. Textbooks In Print 196^ (4l) was 
examined and titles falling in the populations defined 
above were numbered consecutively for each content 
separately. Ten of the books were then selected 
randomly without x*eplacement for each content. 

An instructional passage was chosen from the 
main body of each textbook according to the following 
procedure. A table of random numbers was used to 
select a page number in each book. A search was begun 
at the top of the page selected and carried forward 
until a subtitle was located. A subtitle was regarded 
as any section or subsection heading which is lower 
in rank than a chapter heading. The passage following 
the subtitle was used if It met the following critei»la: 
(a) The passage did not duplicate a topic previously 
chosen for the study; (b) The passage contained at 
least 250 words of continuous prose (A passage was 
considered discontinuous If the reader was directed 
to material outside the passage; e.g., if he was directed 
to figure 1.); and (c) The 250 words did not Include 
more than 10 quoted words. When the topic chosen did 
not meet the criteria, another topic was chosen by the 
same procedure. 

The first 250 words of continuous prose following 
the subtitle constituted the sample passages. 

The ^<0 sample passages were analyzed by a special 
analyst to determine the extent of use of the following 
elements of expression: 

A. Nouns of Abstractlon<—The abstractness of the 

sample passages was estimated by counting 
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Gillie’s "nouns of abstraction.” These are words 
having the suffixes; ness, ment, ship, dom, nee, 
ion, and y. 

1 fPUiSk n ^ . 
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words in each passage. 

”1” words — The number of words beginning with the 
letter "i” in each passage. 

First person pronouns— The number of first person 
pronouns in each passage. 

Second person pronouns— The number of second person 
pronouns in each passage. 

Third person pronouns— The number of third person 
pronouns in each passage. 

Different words— The total number of words in 
the passage minus the number of repeated words. 

Sentence length— The mean number of words per 
complete sentence in each passage. 

Complex sentences — The proportion of complete 
sentences having one main clause and one or more 
subordinate clauses. 

Infinitive phrases— The total number of infinitive 
phrases in each passage. 



The cloze test forms were constructed by a 
systematic deletion process. Every fifth word in the 
sample passages was replaced by an underlined blank 
space, one inch in length. The deletion process began 
with the first word of the first sentence. Pour other 
forms were prepared for each passage by beginning the 
deletion process on the second, third, fourth, and 
fifth words respectively. By using these five forms 
for each passage, every word was included as an item 
to he restored. This procedure provided 200 different 
test forms (four contents represented by ten books 
each, and each book represented by five parallel cloze 
tests) . 

The cloze test forms were typed on offset mats 
and reproduced on 8 1/2 by 14 inch paper, one test form 
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per sheet. The title was centered at the top of each 
sample passage and was not mutilated. Four test forms, 
one for each content, yere bound into a booklet having 
an attached cover sheet of Instructions* These instruc* 
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each booklet, the forms were arranged randomly to control 
for practice effects. 
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Administration of the Cloze Test . The tests were 
administered to students in intact classroom groups. 

The students were advised to follow the administrator’s 
reading of the instructions. Student questions were then 
answered. They were advised that a bell would sound at 
ten minute intervals. Each time the bell sounded, the 
students were told to begin work on the next test form. 
The ten minute periods were used because on a pilot 
administration l6 out of 20 high school students 
completed a similar form in eight minutes. A check of 
the completed test forms of the present study revealed 
that 82 percent had a response in at least one of the 
last three blanks. 



Scoring the Test Forms . To be scored as correct, responses 
had to match the words deleted except for minor mis- 
spellings; i.e., synonyms were not considered to be 
correct. The cloze score for each passage was derived 
by averaging the percentage of words correctly restored 
on its cloze test forms. This score became a basic 
measure for the analyses. 



Analysis . For each content separately, mean& and standard 
deviations were computed for the cloze and expresslonal 
element scores. The significance of differences among 
the mean scores over passages within contents was deter- 
mined through a one-way analysis of variance procediire. 
Homogeneity of the variances of the cloze and expresslonal 
element scores within each content was determined using 
Hartley’s P-Max test for homogeneity of variance, 
according to procedures outlined by Winer (^5). 

Relationships between passage cloze scores and 
Individual elements of expresslonal style were determined 
through correlational analyses. 

The scores for all passages in the four contents 
were then combined into a single distribution. The 
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€5ox*relstlons between cloze scores and each element of 
expression were recomputed using the entire distribution 
of 40 passages o 

k multiple regression analysis was performed, 
using the cloze scores as the criterion variable and the 
expressional elements as the Independent variables. The 
multiple correlation coefficients and squared multiple 
correlation coefficients were computed to show the amount 
of overall relationship between the cloze scores and 
the expresslonal elements. 

The individual restoration scores were analyzed 
using a four variable factorial design. The model for 
the analysis was the following: 

where ® an individual restoration score and 

M » grand mean of restoration scores 
« effect of contents 1, 2, 3, 4 
^j(l) ® of passages within Contents 1, 2, ... lO 

^k(lj) * of deletion forms within Passages and 

Contents 1, 2, ... 5 

^ effect of ability level of subjects 1, 2, ... 5 
and n » 1 

The null hypotheses were: (a) Content effects 

are zero, (b) Passage effects are zero, (c) Ability 
level effects are zero, and (d) The Interaction effects 
are zero. 

The ratios Involved In analysis of variance for 
the several hypotheses were: (a) mean square for content 

me^s to the passages (within contents) mean square, 

(b) mean square for passage means to the forms (within 
passages and contents) mean square, (c) mean square for 
ability means to the passage by ability level Interaction 
^an square, (d) mean square for content by ability level 
interaction to the passage (within contents) by ability 
level Interaction mean square, and (e) mean square for 
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passage (within contents by ability level interaction to 
the form by ability level interaction). 



nesui^s 



Table 3 contains the means and standard devia- 



tions of the passage close scores. The significance of 



differences among means Yor the content areas were 
examined using one-way analyses of variance. Also, the 
homogeneity of variances were tested by Hartley’s P-Max 
test. The F-ratlos and F-Max ratios appear in Table 3. 



Product moment correlation coefficients were 
computed between the cloze scores and the elements of 
expression for each content over passages within the 
content. The correlation coefficients appear in Table 4. 



Significant relationships appear between the 
cloze scores and two or more- of the expressional elements 
for each content area. 



The relationships between the cloze scores and 
four of the expressional elements are consistent in 
direction across the four content areas. The elements 
are monosyllables, first person pronouns, different 
words, and abstract nouns. Only complex sentences bear 
no appreciable relationship with the cloze scores in any 
of the content areas. 



The ten sample passages in each content area 
were combined into a single distribution of forty 
passages. Product moment correlation coefficients 
were then computed among the cloze scores and elements 
of expression in the combined distribution. The 
intercorrelation matrix appears in Table 5. 



The correlations between the cloze scores and 
each of monosyllables, sentence length, first person 
pronouns, different words, and nouns of abstraction 
were significant at the .10 level. Monosyllables and 
second person pronouns were positively related to 
cloze scores; sentence length, first person pronouns, 
diffei»ent words, and nouns of abstraction were 
inversely related to the cloze scores* 



The vocabulary difficulty factor, as measured 
by monosyllabic words, is the best single predictor 
of redundancy. This was expected because vocabulary 
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TABLE 3 



Means, Standard Deviations, and P-Ratlos For 
Passage Cloze Scores and Exprsssional Elaissnts 



Passage World American Chem- P-Ratlo 

Variable History Govte Biology isfcry 



Cloze IT 

Score (%) s 

Number x 

Monosyllable S 

Sentence x 

Length S 

Different x 

Words s 

Number x 

”i” Words s 

Nouns of X 

Abstraction s 

First Person X 

Pronouns s 

Second Per- X 

son Pronouns S 

Third Person x 

Pronouns S 

Complex X 

Sentences (^) S 

Infinitive x 

Phrases S 



35.4 


35.3 


5.3 


8.3 


152.2 


150.0 


21.6 


16.8 


17.6 


17.8 


1.9 


3.5 


151.4 


152.0 


8.6 


10.9 


11.2 


13.1 


4.0 


3.6 


5.7 


6.7 


4.9 


3.4 


.6 


.9 


1.1 


1.9 


.2 


1.5 


.4 


4.4 


9.9 


7.0 


6.3 


5.3 


29.5 


30.2 


13.2 


10.6 


6.3 


4.7 


2.9 


2.6 



35.6 38.4 

8.2 3.3 6 . 

157.7 148.7 .6 

16.0 10.1 4.5 

17.1 16.6 .3 

3.0 3.2 3.6 

144.3 147.2 .7 

17.1 16.6 3.9 

18.8 17.6 3.9 

7.2 7.4 4.2 

6.1 3.6 1.4 

3.1 3.0 3.7 

1.3 .5 .8 

1.2 .7 7.3 

1.3 .4 .7 

2.2 .7 39.5 

6.0 5.1 2.0 

4.0 1.9 11.6 

43.1 37.9 2.2 

16.9 14.2 2.5 

3.0 2.9 4.7 

1.6 2.1 3.1 
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TABLE i* 

Correlations Between the Elements of Expression 
and the Cloze Scores for the Passages 
Within Each Content Area 

N » 10 passages 



iTlemenoo of 
Expression 


World 

History 


American 

Govt. 


Biology 


Chemistry 


Monosyllables 


.66* 


.68* 


.61^ 


.31 


Sentence Length 


.40 


1 

• 

ON 

CO 


.00 


-.75* 


First Person 
Pronouns 


-.10 


-.10 


-.84 


-.35 


Second Person 
Pronouns 


.17 


.65^ 


.14 


-.44 


Third Person 
Pronouns 


.13 


.29 


.60* 


-.32 


Different Words 


-.22 


-.44 


-.17 


-.41 


Infinitive 

Phrases 


.6^^ 


-.24 


.34 


-.36 


”i” Words 


-.64« 


.02 


.28 


.60* 


Abstract Nouns 


-.25 


-.41 


-.37 


-.33 


Complex 

Sentences 


-.01 


-.01 


.14 


-.16 



^significant at .10 level 

36 



I 









m 







mai 





I 



I 



I 



I 



I 



I 



I 



I 



I 



I 



I 



I 



s 



in 



a 

s 

&H 



(!) Q} 

N H 
O Ck 
H S 
O 8 
CO 

c 

(U >> 

a> 

<p o 

<D P:i 
(Z) 

09 O 
O 

•H » 
•P P 
C 

H 0) 

<D e 

U <D 
rH 
O W 
O 



H 

(tf CO 
C Q> 
O bO 
•H OS 
09 GO 
09 00 
0 0 

Cl 

X H 

«g 

*0 o 

§*H 
P 

V 

m 0 
0 

^ p 
O 09 

o c 

CO H 



1 


H 


VO 


o 


o 


VO 


VO 


VO 


o 








i 


O 


O 


J3- 


H 


o 


H 


H 




H 


o 




rH 


• 


• 


• 


• 


Q 


• 


• 


• 


• 


• 






1 
















( 


1 






He 
























VO 




C^ 


rH 


p- 


C7N 


OO 


CM 


O 






O 


CO 


o 


iH 


H 


o 


H 


o 


O 


CM 






r-i 


• 


• 


• 


• 


• 


• 


• 


• 


• 








1 






1 


1 


i 






1 








m 


Jv 


o 


GO 


c?» 


00 


CN 


o 








ON 


H 


rH 


CA 


O 


o 


CM 


CO 












• 


• 


• 


• 


• 


• 


• 


• 














1 


! 




1 


I 


1 










CO 




CO 


VO 


CO 


H 


CM 








' 


oo 


o 


H 


CO 


H 


o 


CM 


rH 












6 


• 


• 


• 


• 


• 


• 












* 


























P- 


CM 


H 


ON 














J>- 


CVl 


CM 


tr> 


o 


o 


H 














• 


• 


o 


• 


• 


l> 














1 


1 




1 


9 
















rH 


HI 


CO 


o 


CO 














vo 


CM 


CO 


o 


c, 


H 
















• 


• 


• 


• 


• 




















1 




1 














; 


Hc 
























in 


H 


VO 


















in 


CO 


CO 


H 


o 


















• 


• 


• 


• 






















1 












































00 


CM 


o 


















cr 


cn 


CM 


H 




















• 


• 


• 




















I 


1 






















9|C 
























CM 


C^ 




















on 


00 


rH 






















• 


• 






















1 


1 






















He 






















CM 


























lA 

V 
































0 






















0 


c 


0 




















c 




C 








C 












3 


o 


2S 








0 












o 


c 


O 




0 




H 




iH 








c 


o 


c 




0 




P 


0 


CCS 








c 


u 


o 




0 




O 


0 


S3 






sa 




dl 




0 


0 




d 




O P 






p 


d4 




dl 


•D 


'y 




u 


s: 


•H C 




0 


u> 




c 




U 






p 


0 


w SJ 


0 


0 


c 


c 


o 


c 


o 


d4 




0 


p 


0 B 


0 


f“l 


0 


o 


0 


o 


3B 






P 


c 


0 0 


h 


JQ 


s^ 


0 


h 


0 




0 




< 


0 


rH 


0 


0 




h 


0 


Pi 


P 


> 


0 




CO 




O 


H 


0 


0 


di 


0 


C 


•H 


•CJ 


U 




w 


CO 


H 


O 


0| 




dr 


0 


p 


u 


0 


X 






>s 


C 




•o 




h 




o 




0 




0 


0 


0 


p 


c 


no 


0 


C 




0 


rH 




t) 




P 


0 


o 


IM 








c 


s* 




o 


c 


c 




o 


•H 




IH 


•» 


s 


E 




rH 


o 


0 


•H 


0 


A 


•H 


C 




0 


O 


1 


O 


s 


CO 




CO 






H 






O 



37 



> 

0 

rH 



in 

o 



P 



p 

C 

0 

V 

•r^ 

<«-l 



£! 

ijO 

•ri 

Sit 



IS 



w 
















lailttM 



> »i» M in w iiif uj i m iii Mj t MUu ■ \ 







I 



I 

I 

I 

i 

I 

! 

I 

I 



8 



I 

I 

8 

i 

I 

I 



difficulty has repeatedly been shown to be the most 
important factor in studies of readability. The next 
best predictor was "nouns of abstraction" followed 
closely by the indices of human i 

second person pronouns, and the sentence difficulty 
factor, sentence length. Different words, a second 
measure of the vocabulary factor, shows the least 
slgniricsnt; r©lfitlonship wll^h th© cloz© scoros* 

Multiple correlations between the cloze scores 
and expressional elements appear in Table 6. 



TABLE 6 



Summary Table 

Multiple Regression Analysis 





Variable Entered 


Multiple 

R 


^ Increase 
r 2 in r2 


P 

Value P 


1. 


Monosyllables 


.5439 


.2958 .2958 


15.9624 .05 


2. 


Abstract Nouns 


.6067 


.3681 .0723 


4.2352 .05 


3. 


First Person 
Pronouns 


.6620 


.4382 .0701 


4.4930 .05 


4. 


Second Person 
Pronouns 


.6997 


.4896 .0513 


3.5200 .10 


5. 


Sentence Length 


.7147 


.5107 .0212 


1.4709 


6. 


Complex Sentences 


.7237 


.5238 .0130 


0.9035 


7. 


Different Words 


.7299 


.5327 .0090 


0.6139 


8. 


Third Person 
Pronouns 


.7370 


.5432 .0104 


0.7080 


9. 


Phrases 


.7392 


.5465 .0033 


0.2177 


10, 


"i" Words 


.7402 


.5479 .0014 


0.0902 






M « 40 passages 




The coefficients were obtained by systematlcallv combining 
the expresslonal elements in the order of their relative ^ 
contribution to the relationship. A multiple R of .70 
was obtained between the cIorp* 

abstract nouns, first S>ersonlronitoi,“^d‘“seoona";ewon 

«ultipxe r 2 indicates that these foS^ 
elements account for k9 percent of the variance In the 

remaining elements added a 

of^onflteLe”*^*’®”'*’"^ R at the .10 level 



1 - 1 «« results of the analysis of Individual restora- 

tion scores appear in Table 7. The error term used In 

Sf ^llytls sLtlln! described In the method 



TABLE 7 



Analysis of Variance of Individual 
Restoration Scores 



Source 


df 


MS 


P 


P 


Contents ( C ) 


3 


138.71 


.51 


NS 


Passages within Contents 










(P w. C) 


36 


273.27 


6.15 


.01 


Forms within Passages and 










Contents (P w. C & P) 


160 


44.44 






Verbal Ability Level (V) 


4 


5,405.71 


159.84 


.01 


CV 


12 


6.37 


• 19 


NS 


7f « /O -- — * 

b rfv \A 9V. Kf J 


144 


33.82 


1.95 


.01 


V X (p w. p a c) 


640 


17.34 






Total 


999 









restoration scores did not discriminate sig- 
nii^cantly among the content areas. Significant differences 

39 
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among the means for passages and for verbal 
lave Is. In addition, a significant passages 
contents) by verbal ability level interaction 
effect was found. 

The mean restoration scores for the verbal 
ability levels appear in Table 8. The means reveal, a 



TABLE 8 



Means and Standard Deviations of Restoration 
Scores for Subjects at Five Ability Levels 



SCAT 

Percentile 



Mean Standard 

Restoration Deviation N 



01-19 

20-39 

i^O-59 

60-79 

80-99 



^3.62 


1ft. 53 


50 


61.62 


13.28 


50 


7<t.20 


12.86 


50 


85.70 


16.06 


50 


96.96 


16.22 


50 






marked increase at each successive level of verbal 

slightly greater increases at the lower 
end of the verbal ability scale. 



4 ^^? significant passage by ability level inter- 
action Indicated that the mean restoration scores for 
the passage by ability level combinations could not 

passage and the ability level main 
effects alone. To facilitate the observation of inter- 
action elfects associated with passage dlfflcultv, the 
40 passages were divided into two groups; the first 
group consisted of the 20 passages having cloze scores 
above the grand mean of the cloze scores, and the 
second group consisted of the 20 passages at and below 
the grand mean. Mean restoration percentages were 
computed for each of the five ability levels over the 
passages in each of the two groups. 



^4 4 . restoration percentages were then 

adjusted to remove the variation attributable to 

variation attributable to 
arbal ability. The adjusted mean restoration per- 
centages appear in Table 9. 





TABLE 9 
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Mean Restcratlon Percentages with Variations 

— A A A W^«A» Ci»4\A 

Verbal Ability Level Removed 



Passage Difficulty 


Verbal Ability Level 


Grand 


Level 


1 2 


3 


4 


5 


Mean 


Easy Cloze 


35.5 35.3 


36.7 


36.7 


36.4 


36.2 


Difficult Cloze 


36.9 37.0 


35.6 


35.9 


36.0 



The adjusted mean scores for ability levels 1 
and 2 tend to be lower in the easy passages and higher 
in the difficult passages than the value predicted from 
the main effects alone, 36*2. The adjusted means for 
ability levels 3j and 5 tend to be higher than 

expected in the easy passages and lower in the difficult 
ones. 

The results show that six elements of expressional 
style are releited to the redundancy of high school instruc- 
tional materials. These expressional elements are 
monosyllable words, sentence length, nouns of abstraction, 
different words, first person pronouns, and second person 
pronouns . 

The findings reveal that instructional materials 
are more redundant if they contain relatively large 
numbers of monosyllable words, lyg e numbers of second 
person pronouns, small numbers ot "nouns of abstraction,'* 
small numbers of different words, small numbers of first 
person pronouns, and a relatively short mean sentence 
length. 

The overall relationship between the measures 
of redundancy and the extent of use of these six 
expressional elements is Indicated by a multiple 
correlation coefficient of .72. 



Discussion 

Relationships were found between redundancy and 
expressional elements ever the passages within each 



m 





content area; however, the predictive value of each 
expressional element varied considerably among the 
contents. Consistencies in direction of relationship 

A. WMA WA4VWAAVO VWA ^ JL ^VUiSA X VA' illWi^UO ^ X JL dU XC fi) ^ 

first person pronouns, different words, and abstract 
nouns. However, these relationships varied widely 
in amount* The remaining six elements varied in 
direction of relationship across the contents as well 
as in amount. No rationale could be advanced to 
account for the different patterns of relationships 
among the content areas. 

The restoration scores did not discriminate 
among the four content areas. This finding indicates 
that the redundancy of instructional materials is not 
associated with the broad subject matter areas. 

The restoration scores were highly and positively 
associated with verbal ability. Also, the scores of 
the high ability subjects provided a finer discrimination 
between the passages of high and of low redundancy. 

It was not possible to test for the effect of 
forms within passages and contents. The amount of 
error caused by using only a single form would decrease 
as the number of cloze blanks became larger and as 
the number of subjects became larger; but it is not 
known at what point the errors would become insignifi- 
cant. 



The restoration scores did discriminate among 
the sample Instructional passages. However, the results 
of this study do not enable drawing conclusions about 
whether differences in redundancy among passages is 
related to the particular topic selected or to style of 
the authors because forty different topics by forty 
different authors were used. It is conceivable that 
the redundancy of each passage reflects the style of 
its author. 



B. The Relation of Cloze Scores to 
Selected Cognitive Variables* 

The major purpose of this study was to investi- 
gate the relationships between cloze scores for 



*Kohler, E. T. An Investigation of Cloze Scores 







Individuals and a set of relatively factor-pure cognitive 
tests. Classification of the abilities involved in the 
cloze procedure would appear to be useful in increasing 
the theoretical and practical potential of the cloze 
procedure when used in aptitude treatment interaction 
studies. A minor purpose of the study was to investigate 
the interrelationships of the cloze scores. 



Method 

S_u bjects . The subjects were 257 tenth-grade students, 
12o males and 129 females, from one senior high school. 
Complete sets of cloze test and “factor— pure” ability 
data were obtained from 243 of the students. There 
was no attempt to restrict the range of ability and 
achievement of this sample because it was desired to 
have a group of tenth-grade subjects with as much 
heterogeneity as is found in a typical tenth-grade. 



Materials . The passages used in the construction of 
the cloze tests were selected from the science and social 
studies passages mentioned previously. There were two 
biology (B5 and B8) and two chemistry (C6 and C7) oassagas 
used in the science area. For the social studies 
tests, two American Government (A3 and AS) and two 
World History (W1 and W8) passages were used. 

Because of the literature on the cloze procedure 
does not provide a useful guide for selecting a 
battery of “factor-pure” cognitive ability tests, the 
selection of these tests was to a considerable extent 
a function of logical judgments about what abilities 
were demanded by the materials. 

A pilot study was done with 30 eleventh-grade 
students. Results suggested that the cloze task Is 
highly verbal but that other special abilities might 
play an important part. Based on this study, the Map 
Planning Test which gives a measure of spatial 
scanning, and the Cube Comparisons Test which gives 
a measure of spatial orientation ( 22) ,“were added to 
the battery. 

A predictor battery having low test inter- 
correlations was desired for use in the multiple 



in Terms of Selected Cognitive Variables. Unpublished 
doctoral dissertation. Florida State University, 1966. 









regression analysis. It was expected that by using 
factor analysis an almost orthogonal battery of "factor- 
pure” tests coyld be devised^ 

The students used in this factor analytic selec- 
tion procedure were 250 tenth-grade students who were 
part of the sample in a study conducted at the Florida 
State University (36). In that study^ a battery of 
thirty-three tests which measured fourteen reference 
factors (22) were administered to approximately 1,200 
public school students in the ninth- through twelfth- 
grades. The thirty-three variables were Intercorrelated 
and a series of principle axis solutions and varimax 
rotations were executed. The matrix resulting from 
the rotation of fourteen factors appeared to be the 
most interpretable. This matrix, the listing of the 
reference factors, and the tests used to measure them 
are reported elsewhere (3^)« 

Of the fourteen factors which were rotated, 
nine were Interpreted. These nine factors served as 
the basis for selecting additional "factor-pure "tests. 
Each interpretable factor was examined in turn and 
the test having the highest loading and most purity for 
a given factor was selected (Table 10) . 

Each student received five scores for each cloze 
test. The first three of these were. most Important: 

(a) A total score. The total number of deletions 
correctly restored o The results and discussion of the 
results will be In relation to this score unless 
otherwise specified, (b) A content word score. The 
number of content words correctly replaced. Content 
words were defined as nouns, verbs, adjectives, 
adverbs and gerunds, (c) A connective word score. 

The number of connective words correctly replaced. 
Connective words were defined as conjunctions, preposi- 
tions, auxiliaries, and articles. 

In addition to these three scores, an "odd" 
words score and "even" words score were obtained. To 
obtain these scores the deletions were numbered from 
1 to 50. The "odd” score was the number of odd 
numbered deletions replaced, and the "even" score was 
the number of even n»^bered deletions replaced. These 
two scores were used only to calculate reliabilities 
of the cioze tests. 
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The analyses are divi<Jed into two categories; 

A W ^ AO ^ A M. 4« ^ 

VA4W V VbA ^GiiL/«2.^ia ^ Ci&AVL Uliv:r UOO^X'JLp UXUll 

of the relationships between the variables or sets of 
variables. The first part of this section presents 
the results which describe the characteristics of the 
cloze tests and the battery of "factor-pure” tests. 
Then the results that describe the relationships 
between the "factor-pure” tests and the cloze tests 
are presented. 



The means and standard deviations for the three 
types of scores obtained from each of the eight cloze 
tests and the mean percentage of correct responses 
appear in Table 11. 



TABLE 11 



Cloze Test Means, Standard Deviations, 
and Mean Percentage Correct 



Test 



Total Score 



J .%0 



Content 
Word Score 



Connective 
Word Score 



B5 


^9 


23.91 5.82 


46 


11.61 


3.54 


50 


12,45 


2.88 


B8 


31 


15.63 6.10 


10 


3.13 


2.29 


62 


12.51 


4.41 


C6 


38 


19.0^1 5,57 


33 


11.58 


3.65 


50 


7,53 


2,61 


C7 


24 


12.19 5.52 


21 


7.25 


3.10 


31 


4,96 


2.92 


A3 


25 


12.72 5.92 


14 


3.98 


2.65 


40 


8,95 


3.84 


A6 


39 


19. <10 6.34 


37 


8.19 


3.58 


58 


11.60 


3,11 


Wi 


28 


13.85 4.31 


11 


3.42 


2.08 


52 


10.44 


2.84 


W8 


36 


17.87 6.89 


27 


9.61 


5.14 


59 


8,25 


2,36 



Table 12 contains the reliabilities of the 
eight cloze tests. 



Two factor analyses were computed on the cloze 
scores. In each analysis unity was placed in the 
diagonal cells as estimates of the communallties and 
all I'actors w5.th eigenvalues s^sster than one were 
rotated. 



^^6 



















TABLE 12 



Cloze Test Reliabilities 



Test 


r 


B5 


.91 


b8 


.87 


C6 


.81 


C7 


.84 


A3 


.86 


A6 


-88 


W1 


79 


W8 


.89 



The first analysis was of the eight cloze total 
scores. Examination of the factor matrix revealed one 
large factor (eigenvalue oi 4.90) which accounted for 
approximately 6l percent of the total variance. 

The second factor analysis pertained to the 
eight content word scores and the elg? t connective word 
scores. It revealed three factors with eigenvalues 
greater than one. In this analysis, as In the first, 
one large factor emerged which accounted for approxi- 
mately fifty percent of the total variance. The eigen- 
value associated with this factor was 8.04. The other 
eigenvalues greater than one were 1.09 and 1.01. The 
second and third factors accounted for seven percent 
and six percent of the variance respectively. These 
three factors were rotated and the rotated factor 
matrix appears in Table 13. 

There were no analyses specific to the "factor- 
pure” tests but as a part of other analyses the inter- 
correlations between these predictor tests were found. 
These are presented in Table 14. 

To explore the relationships between cloze and 
"factor-pure” tests stepwise multiple regression 
coefficients were calculated. Each of the cloze scores 
for science, social studies, and a total were used as 
dependent variables , and the eleven "factor-pure "test 
scores were used as independent variables for the 
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Test 




II 


III 


B8 


Content 


408 


434 


460 


B8 


Connective 


290 


517 


547 


B5 


Content 


548 


242 


447 


B5 


Connective 


500 


162 


512 


C6 


Content 


253 


180 


718 


C6 


Connective 


172 


075 


828 


C7 


Content 


724 


295 


275 


C7 


Connective 


607 


404 


313 


A3 


Content 


784 


133 


179 


A3 


Connective 


731 


150 


313 


a6 


Content 


381 


753 


086 


A6 


Connective 


081 


836 


176 


W1 


Content 


375 


644 


213 


W1 


Connective 


312 


419 


506 


W5 


Content 


724 


373 


209 


W5 


Connective 


694 


265 


189 
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computation of three regression ecjuatlons^ The results 
of these analyses appear in Table 15. The relative 
contribution of each” factor-pure" test for predicting 
the cloze scores is shown in Table 16. 



Discussion 



The results Indicate that Wide Range Vocabulary 
Test . Logical Reasoning , and Inference Test were 
consistently and significantly related to the cloze 
tests. The next most frequently significant tests 
were Addition Test and Hidden Patterns Test . Planning 
Air Maneuvers . Map Planning Test . Object Synthesis , 
and Picture-Number Test . Cube Comparisons Test and 
Figure Classification appeared to be relatively 
unrelated to the cloze tests used. 



A secondary purpose of the study was to examine 
the interrelationships of the various cloze scores. 

This was done by means of two factor analyses. These 
analyses indicate the presence of a general factor in 
the set of eight cloze total scores and in the ^et of 
sixteen content and connective word scores. 



Prom the results of the present study several 
conclusions were drawn. The cloze task was relatively 
independent of the content covered by the tests. Little 
additional information was gained from the use of 
content and connective word scoring schemes. There was 
a general factor present in the cloze scores. The 
analyses of the cloze tests in terms of the ’’factor-pure 
tests provided information about the abilities which 
are required to complete successfully the cloze task. 

The tests which were used to measure these abilities 
are presented below in the order of their Importance 
for predicting cloze scores. 



(a) Wide Range Vocabulary Test . This was thought 
to be a reflection of the subj ect ’ s knowledge 
of grammatical rules and breadth of vocabulary. 
It was considered. as the foundation ability 
in the cloze task. 



(b) Logical Reasoning . This was believed to be a 
somewhat formal reasoning ability which was 
thought to be related to the use of rather 
rigid sets of rules to solve problems. 
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•Variable made a significant contribution to the increase in at the .05 
level or greater. 
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(c) Inference Test . This measure of reasoning was 
thought to reflect a, less formal, more flexible 
approach to the problem of the cloze task. 

(d) Addition Test . The ability measured by this test 
was thought to be important because this speed 
factor provided the subject with more exposure 

to the contextual clues found within the cloze 
test. 

(e) Hidden Patterns Test . This measure of the ability 
to cast aside given solutions in favor of better 
ones was considered to be important because there 
can be many correct words used to replace the 
deletions but to be successful the subject must 

at times cast aside these technically correct 
solutions in favor of ones that are both techni- 
cally correct and correct In relation to the con- 
textual restraints imposed by the passage. 

(f) In relation tc the above”fcctor-pure**tests the 

following appeared to be less important abilities 
in the cloze task: Flgural Adaptive Flexibility , 

Spatial Scanning , Semantic Redefinition , 
Associative Rote Memory . Spatial Orientation ^ 
and Induction. 



C. Relative Redundancy of Reading Material 
with Different Readability Levels and 
Parallel Content 

The purpose of this study was to derive experi- 
mental Instructional passages for use in testing an 
aptltuce treatment interaction hypothesis. The particular 
form of content variable was redundancy as measured by 
the cloze procedure. Previous studies revealed that 
cloze scores of instructional materials were greater 
when the vocabulary was simple, the sentences were short, 
and few abstract words were used. 

An examination of existing reading materials led 
to the identification of a graded reading series having 
parallel versions at different levels of linguistic 
complexity (5j6). The two versions of each passage 
cover the same content but one version has greater 
vocabulary range, greater sentence complexity, and 
longer sentences and paragraphs. These two versions 
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are referred to subsequently as the ’’original” and the 
’’classmate” editions. Four reading passages were 
selected and the relative redundancy levels of the 
two versions of each were determined. The stories 
selected from the original edition are reported by the 
publisher to be at approximately the sixth-grade 
reading level. The parallel versions from the classmate 
edition are reported by the publisher to contain 40^ fewer 
new words, 33^ fewer running words, shorter sentences, 
and shorter paragraphs than the original versions. It 
was hypothesized that thv.< passages from the classmate 
edition would be more redundant than those from the 
original edition. 



Method 

Subjects . The subjects were 8l male and female sixth- 
grade pupils from a predominately Negro public school-. 
Ability data had been collected from them six months 
prior to this study. 
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Materials . Eight cloze tests were prepared from four 
stories contained in the elementary reader entitled 
Stories to Remember and the corresponding versions of 
these four stories contained in the classmate edition 
of the same reader. The stories were; ’’The Shining 
Metal,” ’’Adventures of th^ Whalers," "Independence Day,” 
and ’’The Pony Express Rider.” The eight cloze tests 
consisted of the first 300 words of each story. Every 
fifth word of the text in each cloze test passage 
was omitted and was replaced by a blank line 15 type- 
writer spaces long. Each cloze test contained blanks 
for 60 words. 

The cloze tests wex*e organized into four types 
of test booklets. Each booklet contained four different 
passages, representing each of the stories; two were 
from the classmate edition and two were from the original 
edition. The stories were arranged in booklets according 
to the version as shown in Table 17. A complete set of 
the materials is shown in Appendix A. 



Administration of Cloze Tests . The test booklets were 
distributed rajndomly to the students. 
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TABLE 17 

Story Arrangement In Cloze Test Booklets 



Story 



Booklet 



TT 






IV 



The Shining 
Mstal 



Original Classmate Original Classmate 



Adventures of 

the Whalers Classmate Original Original Classmate 



Independence 

Day 



Original Classmate Classmate Original 



The Pony 

Express Rider Classmate Original Classmate Original 






1 

I 



il 

I 



Instructions for completing the cloze tests were 
read aloud to the students. They were told to: (a) read 

the complete passage at least once before filling in any 
of the blanks, (b) try to fill in the blanks with the 
words you think have been omitted, (c) try to complete 
as many words as possible even if you have to guess, 

(d) reread the completed passage and change any of your 
word entries if you can think of a better word to replace 
it. 

The students coiqpleted the first two cloze tests 
on the first day and completed the remaining two tests 
two days later. All students completed the passages 
in the same sequence: "The Shining Metal," "Adventures 

of the Whalers," "Independence Day," and "The Pony 
Express Rider.” Twenty-five minutes were allowed to 
complete each passage. 

The cloze, tests were scored by comparing the 
subjects' responses with the exact words used in the 
published text. Only legible words which exactly 
matched the words used in the published text, or minor 
misspellings of the exact words, were scored as correct. 
The mean number of words correctly restored to each 
passage was used as the passage cloze score. 
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Analysis . The means and standard deviations of the 
cloze test scores for each version of the four stories 
were computed and the difference between means on the 
classmate version and the original version of each 
story was tested for the significance. 



itesuXts 

The means and standard deviations of the cloze 
scores for each passage are shown in Table 18. The 
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TABLE 18 

Means and Standard Deviations of Cloze Scores 



The Shining 
Metal 



Adventures of 
the Whalers 
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The Pony 
Express Rider 
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Mean 12.44 22.35 18.23 11.95 14.60 20„66 16*55 21.51 
SD 7.46 9.23 4.8o 6.64 6.94 9.81 7.53 8.44 
N 41 ' 40 40 4l 40 41 42 39 



mean scores on the classmate versions were significantly 
higher (p<.01) than those on the original version for 
three of the four stories. "Adventures of the Whalers'* 
was the exception; on that story the mean clor.v* scores 
were higher for the original version. Analysis of the 
two versions of the whaling story indicated no apnarent 
reason for this reversal related to their expressional 
style, rather it appeared that the low cla8srr»ate cloze 
score resulted from the vagaries of sampling In that 
the words deleted from the classmate version contained 
an inordinately large number of key content words which 
are more difficult to restore than connective words. 
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Discussion 



The data indicate that the alternate versions 
of three of* the Tour stories selected were written 
at different levels of redundancy with the classmate 
version being more redundant* No attempt has been 
made to express the amount of redundancy in other than 
relative terms* 



The content of the two versions is similar for 
each of the four stories studied; however, a thorough 
content analysis would require the evaluation of 
subtle differences in expression. Such an analysis has 
not been made. 



In summary the three stories— ”The Shining 
Metal,” "Independence D^y,” and “The Pony Express 
Rider”— were regarded as suitable passages for use in 
investigating the interaction of learner aptitude and 
redundancy level of instructional material. 



D. 



Reading Comprehension as a Function 
of the Interaction of Learner 
Aptitude and Redundancy 



This study is a continuation of the preceding 
one . The specific purpose was to compare the relation- 
ships between the abilities of deduction, verbal, 
reasoning, and perceptual speed, and comprehension 
of a reading passage written at different levels of 
redundancy. Comprehension was measured by a multiple- 
choice test over the material contained In the reading 
passage. 



Method 



Objects . The subjects were seventy-three sixth-grade 
pupils from a predominantly Negro elementary school. 

All sixth-grade pupils were tested but only those who 
had relevant ability measures on record were included 
in the study. The ability tests had been given 
approximately eight months earlier. The median verbal 
IQ of the subjects was 78. The study group was chosen 
because their cognitive ability test data were available 



The subjects were randomly assigned to two 
treatment groups. After the data for those having 
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ability scores were tabulated, it was found that 36 

had received Treatment 1 and 37 had received Treatment 

2 • 
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materials . xne original and classmate versions of ”The 
Shining Metal“ (5»6) were chosen as experimental passages 
because they were short enough to be read in a class 
period and because the two versions had greater differences 
in redundancy than did the other pairs of passages. In 
the earlier study, sixth-grade pupils restored 37 percent 
of the deleted words to the classmate version and 21 
percent to the original version of **The Shining Metal” 
passage. The classmate version contained a total of 
897 words and the original 1,175 words. The stories 
were typed with single spacing and reproduced by mimeo- 
graph. 

A thirty -item four-choice test was constructed 
on the content of ”The Shining Metal." The items dealt 
with general and specific story content common to both 
versions • Kuder— Richardson 20 reliabilities were 
computed for the test, using the separate data from each 
of the treatment groups. The reliability coefficient 
was .84 for the classmate group and .79 for the original 
group. The achievement test is gl.en in Appendix A. 

Pour cognitive abilities were used as predictor 
variables and these are described below. 

A. Deduction - The ability to Interpret correctly 

a verbal argument or progression of evidence and to foimi 
a valid inference based on the Interpretation [Test 8, 

Inferences," of the California Test of Mental Maturity. 
(40)]. 

B. Verbal - The ability to understand ideas 
expressed in words [The "Words Test" and ‘‘Pictures 
Test" of the Primary Mental Abilities . (43)]. 

C. Reasoning - The ability to solve logical 
problems [The "Figure Grouping" and ‘‘Word Grouping" 
tests from the Primary Mental Abilities (43)]. 

D. Perceptual Speed - The ability to recognize 
similarities and different es between objects or 
symbols with speed and accuracy [The "Perceptual 
Speed" test from the Primary Mental Abilities (43)]. 
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Procedure. The reading passages were distributed to 
students with Instructions to study them carefully 
^cause they would be asked questions about them later. 
«iey were Instructed to record the number of minutes 

the passage and to close their 
DooKj.ets when finished. After the pupils had studied 
the passage, the booklets were put aside and the 
achievement test was distributed. Time was allowed 
for the pupils to attempt all test items. 



Analyses. The mean time spent on studying the passage 
and the mean achievement score were computed for the 
classmate and for the original version groups. 

Because the number of words contained in the 
two versions was different, each achievement score was 
divided by the number of minutes devoted to studying 

the passage to derive a rate-of- learning or ’'efficiency” 
score. ^ 

analyzed by plotting the 

regression line for achievement efficiency on ability 
under aach of the treatment conditions . A separate 
plot of the two regression lines was made for each of 
the ability measures. The efficiency scores were used 
as the criterion of achievement in constructing the 
regression lines. 

*he regression plots, the mean, 
deviation, correlation with achievement, 
efficiency, regression coefficient, and regression line 

**”^”*^ computed for each ability measure, 
ine differences between slopes of the paired regression 
lines were tested for significance using an adaptation 
of a technique described by Kenny and Keeping in 
Mathematics of Statistics (32) . 



II 



Results 

The group given the original version of the 
story devoted more time to the study of the passages 
than the group that studied the classmate version. 

time for each is shown in Table 19 . The 
difference between mean study times is not as large 
as might be expected on the basis that the classmate 
version contained only 76^ as many words as the original 
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TABLE 19 



J 



Mean Achievement Scores, Study Times, 
and Efficiency Scores for the 
Two Treatment Groups 




Treatment Group 
Classmate Original 



Achievement Score 



15.7 

15.6 



14.4 



Study Time 
Efficiency Score 



1.1 



16.1 



leO 



The mean achievement scores were higher for the 
total group which studied the classmate version than for 
the group which studied the original (Table 19). The 
classmate version of the material written at a simplified 
level was perhaps more nearly at the educational level 
of the subjects than the original version. 

The difference between overall means indicates 
that the classmate version led to greater achievement 
than the original version. However, this inference 
is probably valid only for groups similar to that on 
which the study was done • To determine If the increase 
in achievement attributed to the classmate version 
applies throughout the range of each ability, the 
regression lines for achievement on ability were plotted 
for each of the ability measures , These regression 
plots are shown in Figures 1 through 4. Differences 
between the slopes of the paired regression lines were 
significant only for reasoning ability. 

Cronbach and Gleser (12) discuss the possible 
interpretations of such regression lines. Their 
discussion is In the context of personnel placement; 
however, the assignment of pupils to different forms 
of content presentation is an analogous use of the 
technique. 



With two treatments, there are three possibilities 
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A. 



The payoff functions (regression lines) are 
Identical, in which case placement Is valueless 
because the treatment to which a man is 

assigned makes no difference in navnff*. 

— 



B. 



The^ payoff function for one treatment is uniform* 
ly nigher than the other for all score levels* 

In this event it is unwise to divide the groups* 
All persons should be given the superior treat- 
ment unless institutional constraints require 
both treatments to be used (e*g*, where there 

arc too few therapists to give psychotherapy to 
all patients}* 



C* 



The payoff function intersects somewhere within 
the score range* If this is the case, it is 
profitable to assign men to different treat- 
ments, so that each rctcelves the treatment that 
"gets the most out of him*** 



The regression lines for all four abilities 
<^nform to possibility C above (Figs* 1, 2* 3, 4). 

These lines reflect an Interaction effect and cross 
within the score range* For all four ability measures 
the classmate version resulted in greater ”payoff” In 
achievement at the upper ability levels and less ”payoff" 
a«# lower ability levels* For example, a student having 
a reasoning score of 35 and studying the original 
version would have a predicted achievement (efficiency) 
score of 1»3 while the same subject would have a 
p^dj,cted achievement score of 1*6 if he studied the 
classmate version. In other words, a student having 

score of 32 who studied the classmate version 
would have the same predicted achievement score as a 
student having a reasoning score of 37 who studied the 
original version* 



Another comparison of within— treatment regression 
appears in Table 20* The regression slopes for deduction, 
reasoning, and perceptual speed differ more from those 
ror verbal ability* The crossover points for all of 
these abilities fall below the mean achievement scores* 



^ only the reasoning regression slopes 
were significantly different, there were consistencies 
across the four plots* The crossover points were 

left of the mean* This suggests that 
the differences in slope may have been created by 
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achieve it differences at the upper end of the ability 
measure range. It Is possible that differences at the 
lower end of the ability range are meaningless. 

In ln\:ex*pretlng the above results, a linear 
relationship between each ability and achievement has 



^ ^ ^ ^ 
CiOOCUUI7U 



Where this oDBuiaptlon Is not valid, the 



regression lines give a distorted picture. The studies 
should be repeated using groups of students having a 
full range of the relevant abilities, and the linearity 
assunq[>tlon should be tested. 



Discussion 

The results of this study provide some support 
to the notion that a pupil's achievement depends upon 
an Interaction between his aptitude and the redundancy 
level of the instructional material used. The data 
do not permit generalization about the form of this 
relationship throughout a wide range of these abilities 



E . Summary 

The studies reported In this section deal with 
redundancy and the execution of them spanned nearly the 
entire period of the project. The first of them 
attempted to ascertain what elements of style are 
related to redundancy. It was felt that Imowledge 
of these would enable the development of a set of 
materials, each differing In redundancy and all dealing 
with the same content, that would be useful In examining 
the ATI theory. The second study attempted to Identify 
what cognitive abilities are most related to redundancy. 
The most highly related of these were logical reasoning, 
vocabulary and Inference. It was felt that the results 
of these two studies would provide Information about 
how to prepare Instructional materials of known 
redundancy and to Identify cognitive aptitudes or skills 
which would be most likely to Interact with level of 
redundancy. The third study was of sets of published 
graded reading materials to determine if different 
versions of the same published work differed signifi- 
cantly In level of redundancy. The results generally 
supported the notion that a strong relationship 
exists between graded reading materials and their 
redundancy level smd thereby supplied the Investigators 
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with rather polished reading passages which have high 
Interest va:<ue and different and known levels of 
redundancy. These materials were then used In the 
fourth study which resulted In the Identification of 
a rather pronounced interaction of reasoning ability 
and materials graded according to redundancy. This 
interaction appears to be sufficiently strong to enable 
assigning students on the basis of aptitude to different 
treatments in a manner which would optimize overall 
achievement. 
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V. ELEMENTARY SET CONCEPTS 



A. Introduction 



The purpose of preceding studies was to attempt 
to identify form-of -content variables in existing textual 
material. The purpose of the study reported here was to 
construct four sets of instructional materials, all 
dealing with the same content but differing in the 
aptitudes required by them for optimal achievement. The 
subject matter was elementary set concepts. The major 
aptitude contrasts were verbal versus figural, and 
inductive versus deductive reasoning. 



One specific hypothesis resulting from the 
aptitude treatment interaction theory (ATI) was that 
verbal ability measures would have significantly higher 
regression coefficients when used to predict achievement 
on verbally presented materials than they would have 
when used to predict achievement on materials presented 
flgurally (or vice versa). Similar hypotheses concerning 
the other ability contrasts were also Inherent in the 
present study. 



B. Method 



Subjects. 



The sample was drawn from two elementary schools, 
In one school, 222 students were tested and 204 were 
tested in the other school. Pour fifth and four sixth 
grade classes were used from each school. Approximately 
equal numbers of males and females were included from 
each school and appeared in the total sample. 



Learning Materials. 



Pour short sets of learning materials were 
developed to teach five basic concepts of mathematical 
sets. These were? definition of a set, definition of 
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elements of sets, disjoint sets. Each of the four 
different types of material was from four to six pages 
in length and provided instruction on only the five 
concepts • 

— v«*. w ^ ^ V / ma c? oc^ili/c^VA viic; 

five basic concepts in a direct expository manner devoid 
of any flgural notation like Venn diagreims and inter- 
section and union symbols. The style was deductive^ a 
concept was presented and followed by several samples. 

The verbal inductive (VI) material contained no 
flgural or symbolic notation and its style was different 
from the (VD) materials. Numerous examples were given 
that were stated to be, say, disjoint sets. The student 
was to induce or discover the appropriate definitional 
attribute for the concept of disjoint sets. The actual 
concept was not explained or defined. 

The flgural deductive (PD) material minimized 
the verbal content and maximized usage of set notation 
and symbols. Venn diagrams were used whenever possible 
in the definitional and examples parts for each concept. 

A deductive style was used to present the defining 
attributes of the concept and then several appropriate 
examples. It should be stressed that the flgural 
material (both PD and PI) minimized verbal usage, it 
did not eliminate it . 

The flgural inductive (PI) material minimized 
the verbal narrative in order to accentuate the symbolic, 
flgural notation. The main difference between the PD 
and the PI type was the presentation style. 

The four sets of materials were used in two 
pilot investigations. The major purposes of these were 
to determine if vocabulary changes were necessary, the 
best format for the achievement test, and the grade 
levels at which the materials would be appropriate. As 
a result, the materials which were finally used in the 
study underwent three revisions. Complete sets of the 
materials are shown in Appendix B. 



Criterion and Ability Tests. 

In conjunction with the four sets of material, 
a criterion "set” test was developed that contained 28 
items. Items were constructed for the last four 
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(elements j disjoint sets. Intersection and tinlon) of 
the five concepts in the instructional material. Items 
were constructed for each concept to represent both 
the verbal and figural dimensions; l.e., a question 
about the elements of the '*set of all animals” would 

4 m ^ am ^ « 

— jL^i i/wva« vcx^uai; aim xx{$urax mooes* 

Of the total of twenty-eight Items, twelve were verbal 
and sixteen were figural. 

The battery of ability tests consisted of the 
Inference test (deductive reasoning) from the California 
Test of Mental Maturity . Level 2, (40), and five~sub- 
tests from the Primary Mental Abilities . Grade Level 4-6, 
(43), tests. The verbal PMA tests were Words Test and 
Pictures Test . PMA Figure Groupin g Test ;wid Word 
Grouping Test were used as tests of inductive reasoning, 
PMA Ferc'eptual Speed Test was used as a test of 
figural ability. 



Procedure 

The study was conducted in two consecutive days 
at each school. Each day's testing required about 1 to 
1 1/2 hours from each class. In every class, the first 
day was devoted solely to administering ability tests. 

The syllogisms test was given first and then relevant 
subtests from the PMA. 

The first task given on. the second day was the 
learning materials. The four sets of materials were 
distributed in a l,2,3j4,l;»2,3,4 etc., order throughout 
the class. Therefore each class had a somewhat different 
distribution of the VD, VI, PD, and PI materials. The 

overall distribution of these materials appears in Table 

21 . 

Before the learning materials were distributed, 
the administrator in charge wrote each of the five 
basic concept words on the board and pronounced them. 

He explained that these words were the concepts to be 
learned. After being given the materials, students 
were Instructed to read through them carefully because 
they would be tested on their contents after finishing. 
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TABLE 21 

Number of Students Who Received Each 










Kind of 


Material 










VD 


VI 


PD 


PI 


Total 


School 


1 


54 


51 


56 


61 


222 


School 


2 


54 


49 


51 


50 


204 


Total 




108 


100 


107 


111 


426 



All students began to read the materials at the 
same time. When each finished he exchanged his booklet 
for a criterion achievement test. 



Very little help was given to students in 
pronouncing words or explaining the concepts. They 
were told to do the best they could and, if they did 
not understand one concept, then to go on to the next 
This procedure was also followed when they took the 
achievement test. 



C. Results 



The means and standard deviations for the verbal, 
figural and total criterion measures for each of the 
four treatment groups appear in Table 22. Means and 



TiiDliC< 



Means and Standard Deviations of Three Criterion 
Measures for Pour Treatment Groups 



Criterion 




Treatment 


; Group 






Test 


VI 


VD 


PI 


FD 




Meet!) 


S.D. 


Mean S.D. 


Mean S.D. 


Mean 


S.D. 


Verbal 


5.91 


2.17 


5.49 2.11 


5.85 2.22 


5.59 


2.11 


Figural 


5.41 


2.04 


5.06 2.20 


5.12 2.19 


5.22 


2.13 


Total 


12.56 


3.89 


11.93 4.12 


12.19 4.23 


11.98 


4.16 
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standard deviations of the ability measures for the four 
treatment groups appear In Table 23, Matrices of 

TABLE 23 

vleSiTiS cuiu Standard Deviations of ability 
Measures for Pour Treatment Groups 



Ability 

Test 


VI 

Mean S.D. 


Treatment Group 
VD PI 

Mean S.D. Mean S.D. 


PD 

Mean S.D. 


Infer- 

ence 


7.57 


a. 72 


7.75 2.62 


7.49 2.90 


7.33 3.02 


Words 

Test 


14.68 


5.83 


14.79 5.75 


14.33 5.67 


13.99 5.97 


Pictures 

Test 


12.59 


4.06 


11.74 3.89 


12.39 4.30 


12.56 4.78 


Figure 
Group- 
ing Test 


15.78 


3.75 


15.68 4.07 


15.46 3.71 


16.60 6.77 


Word 
Group- 
ing Test 


14.69 


4.18 


14.60 6.89 


14.11 4.04 


14.00 4.31 


Percept- 

ual 

Speed 


15.18 


6.08 


13.99 5.90 


14.23 6.35 


14.53 5.58 



Test 



intercorrelations of the ability and criterion variables 
for each treatment group appear in Tables 2k through 27, 

Visual inspections of the means, standard 
deviations, and intercorrelations of the ability measures 
Indicate no differences large enough to preclude comparing 
the regression coefficients for the four groups. 
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TABLE 24 



Intercorrelatlons of Ability and Criterion 
Measures for Treatment Group VI 





12345 


6 


7 


8 


9 


Verbal 

Criterion 


1.00 .50 .87 .22 .kt 


.36 


.28 


.39 


.47 


Figural 

Criterion 


1.00 ,85 .23 .28 


.32 


.24 


.32 


.26 


Total 

Criterion 


1.00 .29 .43 


.40 


.30 


.41 


.44 


Inference 


1.00 .52 


.42 


.28 


.50 


.29 


Words Test 


1.00 


.57 


.21 


.72 


.49 


Pictures 

Test 




1.00 


.20 


.47 


.38 


Figure 

Grouping 

Test 






1.00 


.31 


.31 


Word 

Grouping 

Test 








1.00 


.49 


Perceptual 
Speed Test 










1.00 
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TABLE 25 



Intercorrelatlons of Ability and Criterion 
Measures for Treatment Group VD 





1234 


5 


6 


7 


8 


9 


Verbal 

Criterion 


1.00 .49 .83 .37 


.49 


.46 


.17 


.29 


.42 


Figural 

Criterion 


1.00 .97 .35 


.42 


.48 


.31 


.29 


.33 


Total 

Criterion 


1.00 .42 


.53 


.55 


.28 


.34 


.44 


Inference 


l.OC 


.60 


.57 


.40 


.45 


.33 


Words Test 




1.00 


.64 


.36 


.55 


.51 


Pictures 

Test 






1.00 


.34 


.43 


.35 


Figure 

Grouping 

Test 








1.00 


.51 


.26 


Word 

Grouping 

Test 










1.00 


.31 



Perceptual 
Speed Tbat 



1.00 



TABLE 26 

Inteipcorrelatlons of Ability and Criterion 
Measures for Treatment Group FI 





1230 


5 


6 


7 


8 


9 


Verbal 

Criterion 


1.00 .50 .85 .14 


• 46 


.40 


• 26 


.39 


.24 


Pigural 

Criterion 


1.00 .85 .24 


.44 


.40 


.17 


.44 


.24 


Total 

Criterion 


1.00 .22 


.53 


,48 


CD 

CM 

• 


.48 


.29 


Inference 


1.00 


.46 


.40 


CM 

• 


.44 


.36 


Vords Test 




1.00 


.67 


.26 


.57 


.40 


Pictures 

Test 






1.00 


in 

CM 

• 


.50 


.36 


Figure 

Grouping 

Test 








1.00 


.40 


.21 


word 

Grouping 

Test 










1.00 


.26 


Perceptual 
Speed Test 












1.00 
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TABLE 27 

Intercorrslatlons of Ability and Criterion 
Measurea for Treatment Croup PD 



. 

ERIC. 

d, . . . ^ . »<»* 





1 a 3 4 5 


6 


7 


8 


9 


Verbal 

Criterion 


1.00 .53 .85 .29 .41 


.MO 


.02 


.35 


.45 


Figural 

Criterion 


1.00 .87 .31 .41 


.50 


.06 


.44 


.45 


Total 

Criterion 


1.00 .34 .48 


.57 


.05 


.46 


.54 


Inference 


1.00 .53 


.53 


.11 


.50 


.53 


Words Test 


1.00 


.56 


o 09 


.64 


.52 


Pictures 

Test 




1.00 


.10 


.46 


. px 


Figure 

Grouping 

Test 






1.00 


.16 


ol 6 


Word 

Grouping 

Test 








1.00 


.52 


Perceptual 
Speed Test 










1.00 
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The multiple regression coefficients and multiple 
correlations for each of the criterion measures for 
each of the four groups appear in Tables 28 through 
30. * 



TABLE 28 

Multiple Regression Coefficients and squared Multiple 
Correlations of Ability Measures and the Verbal 
Criterion Por the Pour Treatment Groups. 



Group 



Ability 



Inferences 

Words Test 

Pictures Test 

Figure Grouping 
Test 

Word Grouping 
Test 

Perceptual 

Test « 



VI 


VD 


PI 


PD 


-.065 


.053 


-.129 


■=. 067 


.093 


.073 


.118 


.046 


.058 


.129 


.073 


.122 


.079 


-.0il2 


.061 


-.021 


.008 


.007 


,089 


.031 


.099 


.081 


.022 


.102 




1.920 


1.711 


2.327 



Intercept 
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TABLE 29 



Multiple Regression Coefficients and Squared Multiple 
Correlations of Ability Measures and the Figural 
Criterion for the Four Treatment Groups. 







Group 






Ability 


VI 


VD 


PI 


PD 


Inference 


.017 


.020 


-.029 


-.065 


Words Test 


.000 


.030 


.075 


.008 


Pictures Test 


.095 


.189 


.070 


.151 


Figure Grouping 
Test 


.068 


.070 


-.014 


-.009 


Word Grouping 
Test 


.067 


-.004 


.146 


.108 


Perceptual 
Speed Test 


.027 


.051 


.020 


.080 


Intercept 


1.628 


.504 


1.257 


1.190 


r2 


.160 


.283 


.259 


.339 
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TABLE 30 



Multiple ftegresslon Coefficients and Squared Multiple 
Coz*relations of Ability Measures and the Total 
Criterion for the Pour Treatment Groups. 



Group 



Ability 


VI 


VD 


PI 


PD 


Inference 


.010 


.076 


-.183 


-.195 


Words Test 


.097 


.116 


.216 


.062 


Pictures Test 


.165 


.350 


.166 


.325 


Figure Grouping 
Test 


.147 


.030 


.089 


-.029 


Word Grouping 
Test 


.058 


.004 


.244 


.157 


Perceptual 
Speed Test 


.146 


.151 


.053 


.223 


Intercept 


3.612 


2.883 


2.839 


3.517 
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Although the regression equations In Tables 28 
through 30 provide some evidence of the existence of 
aptitude treatment Interactions » the results are not 
clear-cut. It was felt that the three sets of four 
regression equations, each Including six predictor 
variables were based un interrelationships which were 
too complex to yield easily Interpretable results. 
Therefore, to investigate the aptitude treatment inter- 
action hypothesis, treatment groups were combined into 
verbal and figural groups, and then into deductive and 
inductive groups, and only the relevant ability measures 
in each Instance were used. This reduced the number of 
variables and equations which had to be considered 
simultaneously. Also, It enables basing each regression 
equation on a much larger sample, thereby Increasing Its 
stability. The means and standard deviations of the 
combined groups appear In Table 31 and the correlation 
matrices appear in Tables 32 through 35 • 

TABLE 31 

Means and Standarc^ Bevl7tions of Criterion and 
Ability Measures for v, roups V, P, D and I 



Criterion 

Test 

V (N»208) 


P (M« 


Group 

■218) D(j;*215) 


i (M«211) 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Verbal 5.70 


2.15 


5.72 


2.18 


5.54 


2.12 


5.88 


2.20 


Figural 5.23 


2.13 


5.17 


2.17 


5.14 


2.17 


5.26 


2.13 


Total 12.23 


4.03 


12.09 


4.21 


11.95 


4.15 


12.37 


4.09 


Inference 7.66 


2.68 


7.41 


2.97 


7.54 


2.84 


7.53 


2.82 


V/ords 

Test 14.73 


5.81 


14.16 


5.84 


14.39 


5.89 


14.50 


5.77 


Pictures 
Test 12.14 


4.00 


12.47 


4.56 


12.15 


4.39 


12.48 


4.20 


Figure 
Grouping 
Test 15.73 


3.93 


16.02 


5.98 


16.14 


5.61 


15.62 


3.74 


Word 
Grouping 
Test 14.64 


5.75 


14.05 


4.18 


14.30 


5.76 


14.38 


4.13 


Perceptual 

Speed 

Test 14.57 


6.03 


14.38 


5.99 


14.26 


5.76 


14.69 


6.25 
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TABLE 32 

Intercorrelations of Ability and Criterion 
Measures for Group V 



% 


12 3 


A 


5 


6 


Words Test 


1.00 .60 .50 


.47 


.35 


.48 


Pictures Test 


1.00 .37 


.42 


.41 


.48 


Perceptual Speed 
Test 


1.00 


.45 


.30 


.44 


Verbal Criterion 




1.00 


.50 


.85 


Figural Criterion 






1.00 


.86 


Total Criterion 








1.00 




TABLE 33 








Intercorrelations of Ability and Criterion 
Measures for Group P 






12 3 


4 


5 


6 


Words Test 


1.00 .61 .46 


.44 


.42 


.51 


Pictures Test 


1.00 .43 


.43 


.45 


.52 


Perceptual Speed 
Test 


1.00 


.33 


.33 


.40 


Verbal Criterion 




1.00 


.51 


.85 


Figural Criterion 






1.00 


.86 


Total Criterion 








1.00 
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TABLE 3^ 

Intercorrelations of Ability and Criterion 
Measures for Group D 



12 3 


4 


5 


6 


Inference i.OO .20 .45 


.32 


.33 


.37 


Figure Qi*ouping 

Test 1.00 .29 


.07 


.X6 


.14 


Word Grouping 

Test 1.00 


.31 


.3* 


.38 


Verbal Criterion 


1.00 


.51 


.84 


Plgural Criterion 




1.00 


.87 


Total Criterion 






1.00 


TABLE 35 








Intercorrelations of Ability and Criterion 
Measures for Group I 




CM 

H 


4 


5 


^6 


Inference i.OO .25 ,4? 


.18 


.24 


.25 


Pigure Grouping 

Test 1,00 .36 


.27 


.21 


.29 


Word Grouping 

Test 1,00 


.39 


.38 


.45 


Verbal Criterion 


1.00 


.50 


• 

00 

-«a 


Figural Criterion 




1.00 


.85 


Total Criterion 






1.00 
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The regression equations and squared multiple 
correlations for the three criterion measures appear 
in Table 36 for groups V and P and In Table 37 for 
groups D and I. 



Evaluating the presence of the hypothesized 
aptitude treatment Interaction was done by noting the 
significance of the difference between pairs of regression 
coefficients (32). Each pair of coefficients Involved 
the same ability and criterion measures for the two 
groups being considered. Because the patterns of 
coefficients for all criterion measures were highly 
similar for each group, only coefficients Involving 
the total criterion measure were tested. The results 
of the statistical analyses appear In Table 38. 



TABLE 36 

Regrv^sslon Equations and Squared Multiple Correlations 
For Three Criterion Measures for Groups V and P. 



Ability 

Measures 


Verbal 

Criterion 


Plgural 

Criterion 


Total 

Criterion 




V 


P 


V 


p 


V 


p 


Words Test 


.081 


.090 


.038 


.072 


.133 


.177 


Pictures 

Test 


*099 


.109 


.157 


.1311 


.277 


.281 


Perceptual 
Speed Test 


.09? 


.044 


o0§l 


.0il5 


.164 


.111 


Intercept 


1.886 


2.441 


2.033 


1.83*1 


4.508 


4.469 


r2 


.301 


.244 


.200 


.251 


.334 


.347 
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TABLE 37 



Regression Equations and Squared Multiple Correlations 
For Three Criterion Measures for Grouos D and I* 



Ability 

Measures 


Verbal 

Criterion 


Plgural 

Criterion 


Total 

Criterion 




D 


I 


D I 


D 


1 


Inference 


.176 


-.015 


.164 .048 


.371 


.060 


Figure 

Grouping 

Test 


« 

-.014 


.088 


.018 .040 


.006 


.156 


Word 

Grouping 

Test 


.077 


.183 


.086 .169 


.188 


.373 


Intercept 


3.339 


1.986 


2.384 1.828 


6.377 


4.109 


r2 


.138 


.169 


.155 .156 


.194 


.220 






TABLE 38 






Tests of Significance Betv/een Pairs of 
Regression Coefficients for Grouos 
V and P and Groups D and I. 




Group V Versus Group 


F 


Group !> Versus Group I 


Ability 


t-ratlo 


P 


Ability t 


-ratio 


P 


Words Test 


-.59 > 


.05 


Inference 


2.94 


<.05 


Pictures 

Test 


-.04 > 


.05 


Figure 

Grouping 

Test 


-1.68 


>.05 


Perceptual 
Speed Test 


.55 >, 


► 05 


Word 

Grouping 

Test 


-2.80 


<.05 
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None of the t-ratios for the V-P comparisons 
le significant 3 so there is no support for aptitude 
treatment interaction. However, the D-I contrasts 
support the hypothesis because two of the t-ratios are 
significant at the .05 level and the diff erer.ce» 

hypothesized direction. Thus 
the ^g^srence Test (deduction) is a better predictor 
TSr ^^®^^„®aterials than for the I material^ For 
ggpuping Test (induction) the converse is 



11 

m 



D. Discussion 

contrast of the groups formed by merging 
exposed to deduction and 
respectively, demonstrates the 
of constructing parallel sets of Instruc- 

require different abilities for 
optimal achievement. The failure of the verbal- 

flgural contrast to show ATI effects could have occured 

along this dimension are unimportant 
of elementary set concepts. On the other 
possible that the hypothesized effects 
I ailed to appear because the verbal-figural contrasts 

distinct and/or because the 
iigurai ability measures were not appropriate. 



€ 



1 



u 



E . Summary 

sets nf this study was to construct four 

asatarlals. aU desallBg with the 
concepts but differing In the 
pKh required by them for cptisBal achleirefflent, 

was written to emphaslss the use 
Vpr-hai^s2iif *f ®”® of the following ability eombiaations 

^ flsural-deductive. 

and sixth 

Approximately equal numbers of males 
represented in the sample. Within 
eacn classroom approximately equal fourths of the 
students received each of the four sets of material, 
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Two criterion measures, one containing figural items 
anid the other containing verbal items, were administered. 
In addition all students were administered appropriate 
tests of the abilities under study. 

Regression equations of the criterion measures 
on the ability measures were computet, for each of the 
four groups. While some evidence of aptitude treatment 
Interactions (ATI) were noted they were not as hypoth- 
esized and were not easily Interpretable. In order to 
simplify the analyses the treatment groups were combined 
into vet*bal and figural groups and then into deductive 
and inductive groups. Multiple regression equations 
for the criterion measures were computed for each pair 
of groups using only the relevant ability measures. 

The verbal and figural group equations gave no indica- 
tion of ATI. The contrast of inductive and deductive 
group equations did support the ATI theory. The 
deductive test was a significantly better predictor 
of achievement of the deductive materials whereas the 
verbal Inductive test was significantly better for 
predicting the inductive materials. The figural 
Inductive test did not predict achievement well for 
either set of materials. The results of the study 
demonstrate, at least partially the feasibility of 
constructing parallel sets of material that require 
different abilities for optimal achievement. 

It is possible that the failure of the verbal- 
figural contrast to yield different regression equations 
was due to insufficient differences between the sets 
of materials. Rewriting of the materials to drive 
them apart on the verbal-flgural dimension might allow 
future experiments to demonstrate differential 
predictions . 
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VI. STUDENT AND TEACHER ABILITY 
PATTERNS AND ACHIEVEMENT 
IN CHEM-STUDY* 



A. Introduction 

The research presented in this section of the 
report Is different in that the treattaents described 
here are not sets of instructional materials which 
have different levels of gome form-of- content variable 
but are, instead, teachers having different ability 
patterns. Reviews of investigations of teaching 
methods (44) and of teacher characteristics (27) 
indicate that most cf the reported studies deal with 
evaluating methods or teacher characteristics without 
regard for individual differences that exist among 
students. 

The aptitude treatment interaction hypothesis 
clearly applies to relationships between sets of 
learning materials and student abilities , Although 
it is not as evident, the hypothesis also applies to 
relationships between teacher abilities and student 
abilities. It seems reasonable to believe that a 
teacher of statistics who has high spatial ability 
would tend to capitalize on this ability in his 
lectures and explanations. A student also high in 
spatial ability might tend to profit more from this 
type of Instruction than a student with less spatial 
ability. 

The specific purpose of this study was to 
determine whether achievement of students taking a 
course in .CHEM-STUDY high school chemistry is 
greater for those who are similar in certain cognitive 




•Cleare, B. E. An Investigation of the Inter- 
action between Student-Teacher Cognitive Ability Patterns 
Using Achievement in the Chemical Education Material 
Study Chemistry Course as the Criterion Variable. 

Unpublished doctoral dissertation, Florida State University, 

1966 . 









abilities to their teacher than it is for students who 
are less similar to their teacher when level of general 
ability is held constant. 



6 . Method 
Subjects 

teachers who participated in the study were 
13 of 18 teachers who were enrolled in a CHEM-STUDY 
institute and who were also teaching CHEM-STUDY to high 
school students. The students involved were 917 10th 
grade CHEM-STUDY students who were taught by the 13 
teachers. The number of students taught by any one 
teacher ranged from 21 to 112. 



Tests 

The battery of ability measures consisted of 
seven tests from the ETS Kit of Reference Tests (22). 
Previous unpublished investigations indicate that the 
tests had relatively low intercorrelations and were 
of adequate reliability when used with high school 
students. The seven tests and the factors they 
purport to measure follow: 

A. Wide Range Vocabulary Test (y-S), verbal 
comprehension. 

B. Inference Test (RS“3)a syllogistic reasoning. 

C. Necessary Arithmetic Operations (R-4), 
general reasoning . 

D- Paper Folding Test (Vz-2), visualization. 

E. Gestal t Transformation (Re-1) , semantic 
redefinition. 

P. Hidden Figures Test (Cf-1), flexibility of 
closure. 

Q. Locations Test (1-2), induction. 

The criterion measures were the standard * nd 
CHEM-STUDY unit tests 1, 2, and 3 and the mid-semester 
examination. A pretest was made from the mid semester 




examination by randomly selecting 25 of the 50 Items. 



Procedure 

The ability measures were administered to the 
13 teachers during a meeting of the Institute prior 
to the beginning of the school year. Ability test 
and pretest materials and detailed instructions for 
their administration were given to the teachers, and 
they administered the teste to their students during 
the first month of school. The unit and mid-semester 
examinations were administered by the teachers at 
appropriate times. 



Analysis 

The raw ability scores of the 917 students 
were converted to T scores, and the teachers* scores 
were then converted to T scores on the basis of the 
student norms. A random S6unple of 200 students was 
selected, and reliabilities for six of the tests were 
estimated from the correlations of part-scores corrected 
for length by the Spearman-Brown prophecy formula. 

Only one part of the Wide Range V ocabulary Test was 
given, so its uncorrected reliability"' was estimated 
from previously obtained data frcna approslmateiy 
200 10th grade students. 

Coeffleients of cognitive pattern and level 
similarity were computed for each student and his 
teacher ?ising the intra-class correlation technicue 
presented by Haggard (29). The 917 students were“ 
ranked on the eceffieient of p^ittem similarity and 
were divided into approximately equal thirds. Each 
subgroup was subdivided into two level categories, 
md each oif these groups was divided into males and 
females.* The number of students in each of the 
various subgroups is shown below where and 
indicate high and low levels and ?,, Fo, and 

indicate high, medium, and low pattern similarity 
respectively. 



Lg 





n 


F 


M 


F 




83 


97 


72 


54 


^2 


100 


53 


84 


72 


lx. 


91 


37 


115 


61 








The dependent variable was the number of correct 
pretest items subtracted from the total number of items 
that each student answered correctly in all unit tests 
J^d-term examination, divided by the total 
liUmber of items he was given. The adjustment for total 
necessary because two teachers failed to 
adMnister one unit test. Factorial analysis of variance 

procedures were used to determine 
differences in mean achievement among the various 
subgroups. Since the design was not orthogonal the 
general linear hypothesis was used in the actual 
analysis . 

Simple regression coefficients for the regression 
or the achievement measure on each ability measure were 
computed for each of six teachers who taught more than 
ninety students. A visual inspection was made of the 
regression coefficients for ^ach ability to determine 

whether they covaried with the teacher’s scores on 
the ability. 



C. Results 

The reliabilities of the seven cognitive 
ccaspuved from 200 subjects appear in Table 39, The 



TABLE 39 

Heliabllities of Cognitive Tests 



nil III I III IIS mu I L.tji 



Wide Range Vocabulary Test (V-3) 
Inference Test (Rs~3) 

Necessary Arithmetic Operations 
Paper Folding Test (V 2 - 2 ) 

Ssstalt Transformation (Re-1) 
Hidden Figures Test (Cf-i) 
Locations Test (I-a) 



. 82 « 

.60 

. 7 ^ 

.71 

.62 

.73 

.69 



Estimated from previously gathered data 



intercorrelations of the tests computed from the data 
sor all 917 subjects appear in Table 






TABLE 40 



Intercorrelations of Cogpiitlve Tests 





Rs-3 


R-4 


Vs-2 


Re-1 


Cf-l 


1-2 


V-3 


o52 


.42 


.24 


.32 


.18 


.26 


Rs-3 




.50 


.29 


.25 


.24 


.31 


R-4 






.40 


.37 


.34 


.34 


Vz-2 








.32 


.40 


.30 


Re-1 










.22 


.20 


Cf-1 












.31 



The relationships between the magnitude of reliabilities 
of the tests and the magnitudes of their intercorrela- 
tlons seem to warrant the interpretation that the tests 
are measures of separate cognitive abilities and that 
they are sufficiently precise for exploratory research. 

The results of the 2x3x3 analysis of 
variance in which the dependence of CHEM-STUDY achieve- 
ment on differences in sex, pattern, and level of 
teacher-student similarity was studied appear in Table 
41, The means of the subgroups appear in Table 42. 

The analysis of variairice results and the means support 
the hypothesis that teacher-student cognitive siRdlarity 
is related to student achievement. The overall iii^ans 
for the three pattern groups were .52, .49 and .43 for 
high to low similarity respectively . The means were ,54 
and .42 for the high and low level similarity groups. 
Coefficients of correlation betwec^n pattern siirdlarity 
coefficients and student ability scores were computed 
to determine whether the magnitude of the pattern 
similarity coefficients was independent of the magnitude 
of the student® ability measures. T*he correlations 
were as follows: V-3, .59s Ks-3, .24; R-4, .11; Vz-2, 

-"•IS; He-1, .11; Cf-1, *.22; 1*2, ».07. Because all 
of these correlations are significant, it is possible 
that the §ignific£uit P-ratio for pattern in the analysis 
of variance could be due simply to the ability scores 
of the students and not to the teacher-student similarity. 
The analysis of variance was repeated with the seven 
ability measures as covariates, and it was found that 
the pattex’n similarity effect was still highly significant 








TABLE 41 



I 

I 

I 

I 

I 

1 

I 



Analysis of Variance of CHEM-STUDY Achievement 
by Sex, Level arwi Pattern* 



1 



I 

I 

I 

I 



Source of 
Variation 


D.P. 


Sums of Squares 




P-Ratlo 


P 


Sex (S) 


1 


149,984 




8.25 


<.0l 


Level (L) 


1 


2,860,162 




157.30 


<.01 


Pattern (P) 


2 


1,116,722 




30.71 


<.01 


S X L 


1 


10,378 




.56 


>.01 


S X P 


2 


64,434 




1.77 


>.05 


L X P 


2 


51,038 




1.40 


>.05 


S X L X P 


2 


54,374 




1.49 


>.05 


Error 


905 


16,455,556 








Total 


916 


21 , 450,636 








*Iii this analysis each student’s 
dependent variable xvas multiplied by 100. 


score on 


the 






TABLE 42 








Means 


of CHEM-STODY Achievement 
by Sex, Level and Pattern 


Scores 




Pattern 


Males 


Level 1 Level 2 

Females Males Females 


Px 


.58 


.50 


50 






P2 


.56 


.^3 


^3 




.^12 


P 3 


.52 


.ilO 


^0 




.37 



93 



3^^- O 

t'ERlCO 




(P » 16.95). Interestingly, the F-ratlo for the level 
similarity effect fell to 7.60 but was still significant. 

Table 43 shows the simple regression coefficients 
for each ability and CKEM-STUDY achievement for the 
students of each of six teachers. The standard scores 
for each teacher for each variable are given In Table 
^4. Table 45 contains the means euid standard deviations 
of the achievement variable for the students of each 
teacher. 



D. Discussion 

Visual inspection of the regression coefficients 
and the teachers' scores does not reveal the r^alat ion- 
ships demanded by the similarity hypothesis. It is 
possible that one-to-one similarity .n student-teacher 
ability Is not the most x^elevant similarity. It might 
be that certain teacher abilities or characteristics 
enhance learning in students who are high in complementary 
abilities. An example might be a situation in v^hich 
achievement is facilitated by high auditory decoding 
ability in students when their teachers are high in 
verbal fluency. When teachers have low verbal fluency, 
auditory decoding speed in students might have no 
relationship to achievement. 

The relationship between the pattern coefficient 
and CHEM-STUDY achievement when student abilities are 
held constant does indicate the desirability for further 
research on this topic. Teacher variables other than 
cognitive abilities might be found to Int ?ract with 
student ability measures in affecting ach.^ evement . 



E. Summary 

The purpose of this study was to determine 
whether achievement of students of CHEM-STUDY high 
school chemistry is greater for those who are similar 
in cognitive abilities to their teachers than for 
students who are less similar to their teachers when 
level of general ability is held constant. 

Thirteen chemistry teachers in a CHEM-STUDY 
Institute were administered seven relatively 
factorlally pure ability measures. The teachers then 
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TABLE ^4 



Teachers* Standard Ability Scores 



Ability 




’’2 


Teachers 

Tj Ti, 


^5 


T6 


Vocabulary 


70 


77 


70 


68 


77 


75 


Inference 


56 


69 


61 


69 


48 


58 


Necessary Arithmetic 
Operations 


54 


66 


60 


62 


54 


66 


Paper Folding 


50 


57 


45 


57 


55 


55 


Gestalt Transformation 


5 50 


54 


54 


64 


67 


n 


Hidden Figures 


48 


53 


50 


54 


54 


41 


Locations 


53 


57 


61 


53 


51 


42 




TABLE 


45 











Means 9 Standard Deviations, and Numbers of Students 
of Each of Six Teachers on CHEM-STUDY Achievement 





T 


»r 

“2 


Teachers 

T T 

3 -^4 


5 


^6 


Mean 


.537 


.i«65 


»493 


. 608 


.435 


.349 


Standard Deviation 


.120 


.131 


.132 


4 132 


.128 


.153 


N 


.104 


9*! 


.111 


95 


96 


95 







administerf.d the same tests to their students. Approsi- 
mately 920 students were tested. Pattern similarity 
coefficients i?are computed between each teacher and each 
of his students. Male and female students were Disced 
into three app!?oximately equal pattern similarity 
groups (highly similar to teacher, similar to teacher 
and disslmilai to teacher). Each of these six groups 
was subdivided into two pattern, level groups (about the 
same as the *^eacher and lower than the teacher). The 
criterion naeasure was performance on CHEM-STDDY achieve- 
ment tests. The general linear hypothesis was used to 
analyze the? data. It was found that all three main 
effects and no interactions were significant when student 
ability was held constant. Males had better achievement 
than females students similar in level to the teacher 
did better than students lower than the teacher, and the 
greater the similarity in teacher-student pattern the 
greater the ^^hlevement. 

Simple regression coefficients for each ability 
and achievement were computed separately for the 
students of each of six teachers. No set of regression 
coefficients for a particular ability appeared to be 
related to the teachers' scores for that variable. 

The results of the study support the deduction 
from the ATI theory that students who are similar to 
their teachers in cognitive ability patterns achieve at 
a higher level than do students who are less similar 
to their teachers. The Importance of a one-to-one 
similarity in student-teacher abilities could not be 
demonstrated. 
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VII. CONCEPT ATTAINMENT FROM VERBAL 
AND PIGUML INSTANCES 



A. Introd'^ction 

In the studies reported in prior seotions^t the 
form of content variables were . embedded in textbooks 
or specially prepared Inst rue tlos^al materials. Although 
as much control was exercised as possible over the 
student’s prior knowledge of content when it seemed 
desirable to do the possibility exists that the 
results might have been somewhat effected by unequal 
and uncontrolled initial knowledge. As a consequence^ 
the investigators chose to undertake a series of 
studies based on a standard task from experimental 
psychology about which students would be totally 
unfamiliar. 

The task was concept attainment (7) where the 
relevant materials were either verbal or figural, 

Ramsey (38) used such materials and found that mastering 
verbal concepts required significantly more time than 
did mastering figural ijoncepts, but that no other 
differences existed between the two formB in which the 
concept instances were presented. 

The aptitude treatment interact ion theory 
leads to the prediction of (a) no differences between 
forms (materials 9 content) when heterogeneous subject 
groups are cosi^ared» and (b) significant differences 
between the treatments when subjects are classified 
according to aptitude patterns which are believed to 
be relevant to the tasks. 

The purpose of the study was to identify 
aptitude variables which might be differentially 
related to attainment of figural or verbal concepts 
and then to determine whether the hypothesised 
relationships could be empirically demonstrated. 
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Method 



Task Analysis 

In ea 2 *lisr project studies, the aptltudlnal 
fraia® of reference was the Primary Mental Abilities . 

On the basis of the results* of these studies, the 
erpsrlmenters felt that a broader conception of 
aptitudes was necessary to embrace the rich variety 
of apparent form of content variables. The Structure 
of Intellect (SI) model developed by Guilford (28) was 
chosen t^ecause It seemed to be easily related to the 
form of content variables. A task could be analyzed 
In terms of the SI model and the aptitudes relevant 
for its mastery would appear to be Immediately 
known c This procedu 2 ?e was used In the analysis of the 
concept attainment task. 

The concept attainment task required presenting 
the subject with an array of 64 stimulus cards. Six 
two-valued attributes constituted the array. The 
attributes were (a) number of borders (one or two), 

(b) kind of borders (broken or solid) and (c) number 
of figures (one or two), (d) their size (large or 
small), (e) their color (black or white) and (f) their 
shape (circle or ellipse). One of the 64 cards was 
presented to the subject as a “focus” card and he was 
told to discover the concept of vAilch it was a member. 

Ke selected other cards, one-at-a-tlme, and was told by 
the examiner whether it was an example of the concept. 
The procedure continued until the subject formed an 
hypothesis about the concept and offered it to the 
examiner. If the correct concept was Identified, card 
selection was terminated; if not. It continued until 
the correct concept was attained. Examples of a concept 
could be "black, circular figures” or ”two borders, 

small figures." The subject was required to learn 
four concepts. 

An analysis of the learning task In terms of 
the SI model suggested that learning the first concept 
required two major abilities. One of these is the 
ability to "cognize flgural units” (CPU), which Involves 
selecting a relevant detail out of a complex stimulus 
configuration. The other necessary ability Is the 
’cognition of flgural classes” (CFC). Probably the 
best-suited and available test for this ability is 
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Figure Classification , which involves defining classes 
of figures and assigning other figures to the correct 
classes. 



When the learning task was altered so that verbal 
descriptions of the attributes replaced the actual values 
of the attributes* then a corresponding change of abilities 
was hypothesized to occur. The hypothesized abilities 
would become "cognition of symbolic units" (CSU) and 
"cogpiition of semantic classes" (CMC), respectively. The 
best tests of these abilities probably are Verbal 
Comprehension or Four Letter Wo rds and Verbal Classifica- 
tion . ^ 



It was hypothesized that after the first concept 
had been learned, the "cognition of units" ability 
would become increasingly unimportant. 



Production factors were not hypothesized in 
connection with this learning task because the dependent 
variables were number of cards chosen and number of 
hypotheses offered until the concept was attained. If 
the subjects were required to use the concept subse- 
quently, then production factors might have been of 
lng)ortance. 



Computer programs were used to adxninister the 
tasks to all subjects in the pilot study. In the major 
study some subjects received instruction from a human 
experimenter. 



Tests 



The tests which were actually used did not 
completely conform to the specifications derived from 
the task analysis. Hidden Patterns Test (CPU) and 
Figure Classification (CPC) were specified by the task 
analysis • Pour Letter Words was presumed by the 
investigators to be a measure of CSU. No test of CMC 
was available at the time of the study so Letter Sets 
which is probably a measure of CSC, was used. 

All of these tests were drawn from the ETS Kit of 
Reference Tests (22). Four Letter Words appears only 
in an earlier version of the KIT. 
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Subjects 



Sixteen college sophomores were subjects in e 
pilot study which was conducted to test the experimental 
procedures and to determine the reasibility of subse* 
quently using the Pour Letter Words and Hidden Patterns 
Test in the major study, The other two Fests were hot " 
administered to them. These students were from an 
original group of 80 who were reduced to HQ by excluding 
those who fell within one standard deviation of the mean 
on either test. The survivors were grouped into high- 
high, high- low, low-high and low-low test categories. 
Difficulties with the con^)uter program or with the 
equipment itself further reduced the number of students 
with usable data to four per category. Each of these 
four groups was divided equally, one subgroup receiving 
the figuraX task and the other subgroup receiving the 
verbal task. 



In the major portion of the study the four tests 
were administered to 96 senior and graduate students. 
Seventy-two of them were individually administered one 
of the two forms of the concept attainment task. Only 
51 students actually completed the concept materials, 

24 in the verbal concept group and 27 in the figural 
concept group. 



Testing Conditions 



The 64 concept attainment instances were drawn 
or typed on 3 x 3 inch cards and mounted in random 
order on square pieces of 1/4” plyboard. An instruc- 
tion booklet was prepared and a computer-assisted 
instruction (CAI) program was written in the Course- 
writer language so that an IBM 1440 CAI system could 
serve as the experimenter. CAI was chosen to 
administer the experiment because it would give a 
corq>letely standardized set of Instructions to each 
student and it would serve several students simulta- 
neously. 



When a student came to the experimental session 
a proctor conducted him to a CAI typewriter-terminal 
located in a booth. The proctor explained the use of 
the terminal, had the student type his name, and 
explained the use of the EOB signal which signified 
the end of a student response. 
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The folloi?ing dialogue between ooa^uter and 
subject exesiplifles the experimental procedure; 




type sign on 
sign on 

type course name 
concept 1 
type your number 
81006 

your name Is 13. Biggs 

Please type your group number and enter an EOB 

signal. 

3 

Thank you. 

Mow open the book on the desk and read page one. 
When you have finished, enter an EOB signal. 

Just as all animals may be classified as vertebrate 
or invertebrate so. In a like manner, all cards 
Indicative of (BLACK CIRCULAR FIGURES) may be 
grouped together to form the concept (BLACK 
CIRCULAR FIGURES). Cards 17 and ^0 are two of 
several cards which belong to this concept. Now, 
you pick another card which belongs to the (BLACK 
CIRCULAR FIGURES) concept, and type the number 
of the card you pick. 

REMINDER! Don’t forget to enter an EOB signal 
after you type the card number. 

4 

The card whose number you typed is NOT an example 
of the concept (BLACK CIRCULAR FIGURES). 

Pick a different number. 

11 

Very good! 

Pick another number. 

IS 

Very good! 

Pick another number. 

25 

Very good! 

Now pick a card which does NOT belong to the (BLACK 
CIRCULAR FIGURES) concept, and type the number of 
the card you pick. 

1 

O.K., pick one mcx»e card which does not belong to 
the concept. 

2 

That’s fine. 

Now read pages two, three, and four in the book and 
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enter an EOB signal ^en :^ou have finished » 

To make sure you kno%r how to enter your hypothesis 
correctly, type the relevant letter combination 
for (BLACK CIRCULAH FIGURES) » 
jlc 

Very good! 

We are now ready to begin the first task. If 
you have any questions now or later, you may go 
back and read the Instructions I have just given 
you. Before we beg^in please look at the clock 
and type the time to the nearest minute as 
accurately as possible. 

1223 

Thank you. 

The focus card is number 25. Select a card and 
type the number of the card you select. 

1 

No. Pick another number or type hyp. 

Pick another number or type hyp. 

Pick another number or type hyp. 

You are now ready to enter an hypothesis. Type 
the letter combination that corresponds to the 
hypothesis you have chosen, 
hk 

Your hypothesis is incorrect. • 

The focus card is number 25. Select a card and 
type the number of the card you select. 

18 

Yes. Pick another number of type hyp. 

hyp 

The array board was mounted on a wooden easel 
beside the typewriter terminal. A 5 x 9 inch hypotheses 
card was on a table at the side of the terminal. This 
card is reproduced below: 



ATTRIBUTE VALUE 



Number of Borders one « a 

two ® b 

Continuity of Borders solid * c 

broken » d 

Number of Figures one » e 

two ® f 

Slise of Figures. .large * g 

small « h 



Yes. 

Yes. 

hyp 




Color of Figures. white ® i 

Shape of Figures. , . circle « k 

ellipse « ’ 



To enter an hypothesis ^ type the letter combination 
that describes the relevant attribute values and 
then enter an EOB signal* 

gQr_E_xample t The relevant attribute values that 
describe the hypothesis for the concept (BLACK 
CIRCULAR FIGURES) are j for black and k for 
circular. This hypothesis would be entered in the 
following form and followed by an EOB signal. 

The booklet of instructions which the subjects 
read when told to do so by the con^uter Is reproduced 
below* These instructions follow closely those used bv 
Ramsey ( 38 ). 

INSTRUCTIONS FOR CONCEPT FORMATION TASKS 

This experiment is concerned with how people 
attain concepts. You are asked to work several 
exercises in concept attainment* Your performance 
on these tasks is not related to your course 
grade . 

On the easel before you is a display of 64 
cards. Each card contains six attributes. The 
attributes are number of borders, type of borders, 
number of figures, size of figures, color of 
figures, and shape of figures. Each card has 
either one or two borders, broken or solid borders, 
one or two figures, large or small figures, white 
or black figures, and circular or elliptical- 
figures c 

Every card on the board is different from 
every other card in at least one of the six 
attributes Just described. However, there are a 
number of ways certain cards may be grouped so that 
all cards in a specific group possess one or mere 
of the same attributes. To illustrate from the 
animal kingdom, we know that all animals can be 
classified into two distj.net groups— vertebrate 
or invertebrate. Thus, every animal either does 

10^ 










or does not have a backbone and may fee put Into 
either group»**vertebrate or invertebrate. When 
you have reached this point in your reading enter 
an EOB signal. 

REMEMBER! ! After each response, you must enter 
an EOB signal. (End of Page 1 of Directions) 

You have just seen an example of a concept 
that has two relevant attributes, the two relevant 
attributes being color and shape of figures. The 
correct way to identify the concept is shown at 
the bottom of the attribute card on the desk to 
your right (look at the card carefully before you 
continue reading). For color of figures was 
chosen and for shape of figures ”k” was chosen 
because the concept is (BLACK CIRCULAR FIGURES). 
None of the values for the other four attributes 
was chosen since they were not part of the concepts 
In subsequent problems when you wish to offer am 
hypothesis about a concept you will type **hyp” and 
then enter an EOB signal. You should then type 
the identifying letters of the attributes that you 
think define the concept. Refer to the attribute 
card to find the identifying letters of correct 
values of the attributes. 

All of the concepts you are to obtain have 
only two relevant attributes, therefore, you will 
ngvor type more th an two letters when you test an 
hypothesis . 

In this experiment your Job Is to attain the 
concept that I have selected. At the beginning of 
each task I shall type the number of one card 
which belongs to ^ concept that I have selected 
and which you are to attain. This card we will 
call the focus card. You are to select cards 
which you want to test as belonging to the same 
concept as the focus card. Select each of your 
successive cards by typing the number of the card 
you chose and enter an EOB signal. After each 
selection I shall type "yes” or ”no" depending 
upon whether or not the card you selected belongs 
to the concept. As you find which cards do and 
do not belong to the concept you can ascertain the 
concept . 

Whenever you think you know the concept type 
"hyp” and I will let you enter your hypothesis In 
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the manner described 
correct, the task is 
to the next one* If 
and you xviil continue 
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as many hypotheses as 
attain the concept as 
you have reached this 



above. If your hypothesis is 
completed and we will go on 
not, 1*11 say "not correct" 
selecting cards until you 
the concept. You may present 
you like. The job Js to 
quickly as possible. When 
point press the EOB signal. 



Bedause of difficulties in scheduling coBq)uter 
time and because a number of students who were unfamiliar 
witij CAI could not attain the concepts, approximately 
half the students (N » 29) were run with a human 
experimenter. He followed the computer procedure as 
closely as possible, but he did vary his explanations 
when students appeared not to comprehend the task. 

The four concepts were arranged into four 
sequences and approximately one-fouith of the students 
completed each sequence. The N*s for the four sequences 
were 13, l^i, 12 and 12. 



Analysis 

Because there were only sixteen students in 
the pilot study, no formal statistical analysis of their 
data was made. The subgroup means for total card 
choices are presented in the next section of this paper. 

In the major study a preliminary analysis of 
the means of the CAI experimenter versus the human 
experimenter groups and an analysis of the means of 
the different sequence groups Indicated no significant 
differences in either case. These independent variables 
were ignored in subsequent analyses. For each pair of 
tests (verbal or flgural closure and verbal or flgural 
classification) the students in each treatment group 
were divided into high-high, high-low, low-high, and 
low-low subgroups. The general linear hypothesis method 
of statistical analysis was used because these subgroups 
did not contain the same numbers of students. The 
dependent variable was number of card choices to the 
correct hypothesis. Only the last two concept attain- 
ment problems and their total were considered in the 
analyses because intercorrelation matrices for the 
four problems computed separately for each treatment 
group indicated that performance on only the last two 

106 



SI 



If® O 

ERIC 
















I 

I 

I 



problems was sufficiently stable to give reliable results. 
NuEober of hypotheses was also considered as a dependent 
variable but the intercorrelation matrices for the four 
problems for this variable indicate that it was not a 
reliable performance measure. These intercorrelations 
matrices and the general linear hypothesis analysis are 
presented in the next section. 



C. Results 

The means for the subgroups of the pilot study 
are presented In Table ^ 6 , Support for the aptitude 
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Ti^LE M6 

Subgroup Total Card Choice Means for Plgural and 
Verbal Concept Attainment by High and Low 
Classification on Verbal and Plgural 
Closure Tests 

N « 16 



Tests 

Four 



Treatment 

Plgural Verbal 

Hidden Patterns Test Hidden Patterns Test 



Letter Words 


High 


Low 


Total 


High 


Low 


Total 


High 


22.5 


28.0 


25.31 


29.0 


24.5 


24.81 


Low 


25.5 


35.0 


30.31 


36.0 


21.0 


28.51 


Total 


24.0 


36.5 




37.5 


22.81 





treatment interaction (ATI) hypothesis is best seen In 
the meams of treatment by Hidden Patterns Test groups 
averaged over Four Letter Words . For the flgural 
treatment, persons who were high in flgural closure 
or cognition of flgural units did better than persons 
who were low in this ability. For the verbal treat- 
ment, the reverse pattern is true. 
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Support for the ATI hypothesis is not presented 
in the pattepK of means in the treatment by Four Letter 
Words groups averaged over Hidden Patterns Tii¥ ^ Persons 
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units made better scores than persons low in this 
ability regardless of treatment. 

The results of the statistical analyses of the 
data from the major study appear in Tables through 
50, 
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Inter correlations of Card Choice Scores for 
Four Concept Attainment Problems for 
Verbal and Figural Treatments 





Verbal 






Figural 




Problem 






Problem 




2 3 


4 




2 3 4 


1 


.09 .25 


-.07 


1 


t 

.21 -.01 -.16 


2 


-eOi 


.23 


2 


.26 ,01 


3 




.51 


3 


.56 






TABLE 48 






Intercorrelations of Number of Hypotheses Scores 
For Pour Concept Attainment Problems for 
Verbal and Figural Treatments 




Verbal 






Figural 




Problem 






Problem 




2 3 


4 




2 3 4 


1 


.12 .16 


.02 


1 


-.30 -.13 -.19 


2 


•25 


.57 


2 


.49 .23 


3 




.01 


3* 


— • 20 
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TABLE 49 



F-oRatios fox» General Linear Hypothesis Analysis of 
Yerftai-Flgurai Treatment by High-Lew Figure 
Classification by Klgh-Low Letter 
' ' #ets Design 



Source of 
Variation 


Degrees 

of 

Freedom 


Concept 

Three 


Concept 

Pour 


Total 

Concept 


Figure 

Classification 


(F) 1 


6.84* 


icOl 


3-81 


Letter Sets 
Test (L) 




.05 


.01 


.03 


Treatment (T) 


X 


as 


.59 


.50 


P X L 


1 


a5 


.03 


.09 


P X T 


1 


.01 


.01 


.02 


L X T 


1 


-23 


.09 


.00 


P X L X T 


1 


.03 


.60 


-34 


Error 


45 









*sigRif leant beyond .05 level 
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TABLE 50 



P-Ratlos for Oeneral Linear Hypothesis Analysis 

a *S a ^ — — ^k. 4»> ^ — jtm %- -- « . <3 SM 

w* xg^ujt^tt j. xxc^umcnv oy iRl^^iiOW 

Hidden Patterns by High-Low Pour 
I«etter°¥Qgds Design 



Source of 
Variation 


Degrees 

of 

Freedom 


Concept 

Three 


Concept 

Four 


Total 

Concept 


Hidden Patterns 
Test (H) 


1 


2.71 


1.52 


2.65 


Pour Letter 
Words (W) 


1 


• 

M 

00 


1.95 


1.20 


Treatment (T) 


1 


• 

o 

VO 


.39 


.05 


H X W 


1 


.51 


2.49 


1.84 


H X T 


1 


CM 

• 


.40 


CM 

O 

• 


W X T 


1 


<M 

CO 

• 


o 

o 

• 


.21 


H X W X T 


1 


.02 


.02 


o 

o 

• 


Error 


^5 
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D. Discussion 



A fD^T «« A 
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The statistical analyses give no support to the 

!• UX^VUOX^lltVX'C ^ UUXjr r Al^UX^g V/ J>gPOXX AUClUX .m 

showed a relationship to concept attainment. A numher 
of reasons for failure to support the ATI hypothesis 
were apparent. First, and probably of most importance, 
was the lack of consistent performance by the students 
on the concept attainment tasks. The low interconcept 
correlations indicated that chance was an important 
determiner of success on the tasks » Second, the 
ability measures were not the precise ones indicated 
by the task analysis. Third, the verbal tasks may not 
have been semantic in nature.* 



It is suggested that future studies of ATI using 
this kind of concept attainment task should require the 
students to attain six or eight concepts in order to 
assure obtaining reliable measures of performance. A 
re-analysis of the task should be made to determine if 
more appropriate aptitude measures could be chosen. 

In addition, further modifications of the tasks might 
lead to a sharpening of the differences between the 
treatments . 



^ The use of CAI as a substitute for the human 
experimenter seems to be feasible. But it is recommended 
that if these procedures are to be used in the future, 
additional time be spent to train subjects in the use 
of the CAI student terminal. 



Summary 



Two studies were conducted in which performance 
on verbal and figural concept attainment tasks were 
related to aptitude variables which were believed to 
be relevant to the concept tasks. The concept tasks 
were presented by either computer assisted instruction 
facilities or by a human experimenter. 



As a result of a task analysis based on the SI 
model, it was hypothesized that figural concept learning 



*Dr. Ralph Hoepfner. Personal communication. 
Assistairit director. Aptitudes Research Project, University 
of Southern California, 1966. 
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would be related to two flgural ability factors, CPU 
and CPC, performance on the verbal concept task would 
be related to a semantic factor, CMC and a symbolic 
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A pilot study was conducted to test out the 
experimental procedures. No statistical analysis was 
made of these data but the results tended to support 
the ATI theory. In the major Investigation, 24 students 
were presented the verbal concept tasks while 27 students 
were presented with the flgural concept task. Approxi- 
mately half of each of these groups were administered 
the tasks either via computer or human experimenter. 



Pour concepts, presented in four different 
sequences, were attained by each student. Dependent 
variables were the number of instances selected and 
the number of hypotheses offered. No differences were 
found between the computer versus human experimenter 
groups or between different sequences of presenting 
the concepts. The statistical analyses which tested 
the interaction of treatments and ability patterns 
gave no support for the ATI theory. Failure to support 
the theory might have been due to unreliability of the 
criterion measures, unfamiliarity of students with 
CAI equipment, or to an inadequate task analysis which 
resulted in the choice of inappropriate ability 
measures. 
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In the concept formation study reported in the 
preceding section the following hypotheses, based on 
the aptitude treatment Interaction (ATI) theory, were 
tested: (a) no difference between treatments when 

heterogeneous subject groups are compared, and (b) 
significant differences between the trs-atments when 
subjects are classified according to aptitude patterns 
believed to be relevant to the tasks. No support for 
the theory was obtained. 

The general purpose of the studies reported 
in this section was to test further the second 
prediction mentioned above. These studies are based 
on vocabulary learning tasks which are probably more 
meaningful to students than au*e concept formation tasks. 
Also, the task analysis procedures for determining 
relevant abilities were Improved, 

The first study deals with the identification 
of abilities which appear to be of importance in 
learning vocabulary words by each of two methods. The 
second study is a pilot investigation of the inter- 
action of these abilities and three methods of teaching 
vocabulary (of which two were developed in study one). 

The third study is a large-scale replication of the 
second study and it includes revised learning materials. 
The fourth study is similar to the preceding two 
except that the interaction of ability and method is 
investigated over a prolonged period of training. 

Cronbach and Gleser (12) state that the 
comparison of regression coefficients is more appropriate 
in exploring ATI than is the comparison of correlation 
coefficient for the following reasons: First differ- 

ences in correlations may result from differences in 
variability only and second crokisover points for the 
regression lines may be computed to determine whether 
they cross within the range of scores of the independent 
variable. If they do not, then one treatment is always 























better than the other. In the studies reported in this 
section, correlations rather than regression coefficients 
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studies and the large number of comparisons to be made. 
In addition, the criterion measures favored one of the 
treatments and thus reduced the possibility that the 
crossover point of the regression lines would occur 
within the range of ability scores when that treatment 
was involved. 



A. Identification of Relevant Abilities for 

Two Methods of Learning Vocabulary Words 

Johnson and Stratton (31) demonstrated that 
teaching the meanings of words can be done equally 
well by four methods. These methods are presenting 
definitions directly, having students derive word 
meanings from context, giving a series of short sentences 
that relate to the words to be learned (classification 
method), and utilizing synonyms. They also used a mixed 
method which was superior to the others. 

The Johnson and Stratton study served as a point 
of departure in designing the study described below. 

The purpose of this study was to Identify abilities which 
seemed to be necessary for learning vocabulary by two 
different methods of instruction. 



Method 

Materials . Two kinds of verbal concept materials were 
devised. These corresponded to the definition and 
classification methods used by Johnson and Stratton. 

In the definition material, the meanings of the words 
to be learned were simply stated in expository form. 

The student’s task was to read the definitions and to 
rewrite them in his words. 

In the classification material, a series of 
sentences relating to the words to be learned were 
presented In an inductive manner. The subject responded 
to each sentence by writing next to it a word, selected 
from several, that he thought best fitted the meaning. 
When he did this, the correct answer was identified and 
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eventually, after presenting the series of sentences. 
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These words were to be learned; limpid, duress, 
lissome, saj.ubrioas, nascent and paroxvsm. Thev were 
regarded as appropriate for the study because tLr 
were defined correctly In a multiple choice vocabulary 
test (V-4 of the Kit of Reference Tests) by less than^ 
20 percent (chance-level) of a samole of 80 under- 
graduate students who were enrolled in an educational 
psychology course o 



In the definitions material, each word was used 
in a rather specific way in a sentence and it was 
followed by a more general definition in a second 

sentence. Each student then wrote the definition in 
nls words . 



In the classification material, sis short 
sentences for each word were constructed* Each set 
of six sentences (1 for each word) was typed on a 
separate page. On each succeeding page, the correct 
answers for the sentences of the previous page were 
presented and a new set of sentences was presented. 
«^acli page contained a different order of sentence 
(meaning) presentation. 



Subigc^. Registrants in a graduate-level class were 
used as subjects. Six of them received the definition 
material and another six received the classification 
material. 



Procedure. After the students completed the leax'ning 
tasks, they were presented a list of 2k words that 



^ ^ V M V/X f«wX Uw viiCXv 

were synonps of the six words that were to be learned. 



mu^ i — ' uiuxi/ wcx'« 50 oe xearj 

The students were directed to write the appropriate 
word, of those that were learned, after each synonym. 
There were four synonyms for each word. 



^ ^f^®^ the criterion test was oomplt?ted each 

of paper. Each contained 

the definition of an ability from Guilford’s Structure 
or intellect (SI) model and an example in the form of 
test item which is used to assess it. Most 
Ox the definitions were taken from Allen, Guilford and 
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Merrifield (1). The 16 abilities were selected so that 
all were from the semantic dimension of the SI model, a 
test was available for each, and the ability was 
verbally defined. Sixteen abilities met these specifi- 
cations and they appear in Table 51 • 



TABLE 51 

Abilities Used in Pilot Study I According 
to Guilford’s SI Model 



Model 

Label 



CMU 



CMP 

CMS 

CMT 

CMI 

MMU 

NMU 

MMC 

NMR 

jms 

NMT 

NMI 

EMU 

EMC 

EMR 



Verbal 

Description 



Verbal comprehension 
Conceptual classification 
Semantic relations 
General reasoning 
Penetration 
Conceptual foresight 
Memory for ideas 
Concept naming 

Convergent production of semantic classes 

Semantic correlates 

Semantic ordering 

Semantic redefinition 

Deduction 

Evaluation of Semantic Units 
Evaluation of Semantic classes 
Evaluation of Semantic relations 
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Results 
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the extent he thought each would be Important In 
learning the meanings of the words. A rank of 16 was 
assigned to the most Important ability. The average 
rank total? for the abilities for each of the two sets 
of materials appear in Table 52. For comparison 



TABLE 52 



Average Rank Totals for th^ 16 Abilities 
for the Tvyo Types of wc.terials 





Classification (N«5) 


Definitions (N»6) 


CMU 


11.0 


15.2 


CMC 


11.0 


10.7 


CMR 


11.2 


11.3 


CMS 


4.8 


5.8 


CMT 


7.4 


5.8 


CMI 


2.0 


4.3 


MMU 


7.8 


10.7 


NMU 


10.6 


11.3 


NMC 


13.6 


12.0 


NMR 


8.2 


9.3 


WiH 


5.6 


3.3 


NMT 


8.2 


4.3 


NMI 


4.8 


8.0 


EMU 


12.2 


9.5 


EMC 


9.4 


7.7 


EMR 


8.2 


8.2 


117 



*>'**'■ '5. *r . rV*''G ' 



' I wi jj I II I 1 1 1 1 





purposes, the top-ranked 7 abilities, as viewed by each 
of the groups, appear in Table 53. 



TAlBLE 53 ♦ 

Seven Top Ranking Abilities as Viewed 
by Two Groups of Judges 



Classification 



Ability 


Rank 


NMC 


1.0 


EMU 


2.0 


CMR 


3.0 


CMU 


^.5 


CMC 


4.5 


NMU 


6.0 


EMC 


7.0 



Definitions 
Ability Rank 



CMU 


1.0 


NMC 


2.0 


CMR 


3.5 


NMU 


3.5 


MMU 


5.5 


CMC 


5.5 


EM^^' 


7.0 



*The seven top abilities according to each group were 
reranked according to the average rank total given 
in Table 53. 



Discussion 

The two groups of students generally perceived 
the same abilities as being most important for learning 
the material. Only EMC (Evaluation of semantic 
relations) and MMU (Memory for ideas) were not common 
to the top rankings of the groups o However, the groups 
differed with regard to how they ordered the abilities 
which were perceived to be most important. The rank 
order correlation of the six commonly selected abilities 
was -.3^ which suggests that there is a somewhat differ- 
ent ability pattern needed to learn each of the two tasks. 





In general, both groups identified primarily verbal 
meaming abilities (verbal, comprehension, conceptual 
classification, semantic relations, concept naming, 
convergent production of semantic classes and evaluation 
of semantic units) as being important but they placed 
them in different rank orders. 

The relatively high agreement within groups 
coupled with the different orders of ranking between 
groups seemed to warrant the use of the ability measures 
in future empirical studies of ATI. 



B. Pilot Investigation of Three Methods 
of Leaning Vocabulary Words 

In the preceding study, eight abilities were 
selected as being relevant to learning vocabulary words 
by two different methods. Six of the abilities were 
selected as Important for both methods but their rank 
orders differed. One ability which was specific for 
each method was identified. 

The general purpose of the second study was 
to determine empirically the relationships between 
these eight abilities and achievement of vocabulary 
material under the two methods of the first study plus 
one other method devised by Johnson and Stratton (31). 
The specific purpose was to try-out the tests and 
materials before administering them to a large group 
of subjects. 



Method 

Subjects . Twenty-six students from grades nine through 
twelve were used. 



Materials . Three sets of learning materials were used 
in this study; definition, classification, and synonyms. 

The definition material consisted of verbal 
definitions for 4 different arid difficult words— 
paroxysm, salubrious, altercation and alacrity. Each 
word was defined somewhat specifically in one sentence 
and it was followed by a more general statement of 
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definition in a second sentence. An example of this 
procedure is given belov. 



A person undergoing a visible and violent 
reaction from either physical or emotional causes 
can be said to be having a paroxysm. Thus a 
paroxysm is any unusually explosive excitation. 



A space followed the definition and the student was to 
write in it the definition in his words. 



In the classification material, the meanings of 
H words' were taught inductively. On each page (six 
pages in all) there were five short sentences each of 
which gave a clue to the definition of a particular 
word. The words to be learned appeared at the top of 
the page and each was to be written in the space next 
to the sentence that pertained to it . Although five 
sentences appeared on each page, only four of them 
dealt with the word to be learned. After the student 
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sheet to determine if his choices were correcw or not. 
This procedure was used on all pages. This approach 
provided a repeated trial and error matching of words 
to sentences, and the assumption was that correct 

words used in the classification material were: duress, 
limpid, lissome and nascent. A sample page is given 
below. 



List 1: duress ,n limpid, lissome, nascent 

List 2: 





duress 



5. A wild bird trys to escape 

through the bars of his cage. 

In the synonym material the same basic procedure 
was used as with the classification material except 
that single word Synonyms werve Utilised instead of 
Short sentences. The 4 words learned by this method 
were: antipodal, ignominious, stripling and succinct. 

One of the six pages which were used In the study is 
reproduced below. 



List 1: 


antipodal, ignominious. 


stripling, succinct 


List 2 ; 




(On back 
of page) 


1. 


lad 


stripling 


2. 


dishonorable 


ignominious 


3. 


short 


succinct 


4. 


heal 


none 


5. 


opposite 


antipodal 



Nine of the 12 words which were Included in the 
pilot study had Thorndike -Lorge (42) counts of less 
than 1 in a million. Three of the words — antipodal, 
lissome and salubrious — were not In the Thorndike- 
Lorge list. 



Tests . Two criterion measures were constructed for the 
words of each method. The first test, synonym produc- 
tion, consisted of the relevant words and spaces in 
which the subjects were instructed to write as many 
synonyms as they could within a five minute time period. 
This test was also used as a pretest. The second test, 
synonym matching, consisted of the list of words to be 
learned followed by a list of synonyms in random order. 
The subjects were instructed to write the number of the 
appropriate word by each synonym. Five minutes was 
the time limit for this test. Complete sets of learning 
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materials ana criterion tests “are shown in Appendix C. 
A battery of nine ability measures was used^ 
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tion of semantic relations (DMR), was included with 
tests of the eight abilities previously identified, 
because it was felt that it might show differential 
correlations over the three methods with the synonym 
production test. The 9 ability measures and their 
respective SI factors are shown in Table 54. 

TABLE 54 

The Nine Ability Measures and Their Respective 
Factors Used in Pilot Study II 





Tests 


Factors 


1. 


Word classification 


Conceptual 
classification (Cf^C) 


2. 


Verbal analogies 


Semantic relations 
(CMR) 


3. 


Wide range vocabulary 
(V-3) 


Verbal comprehension 
(CMU) , 


4. 


Controlled associations 


Assoclational fluency 
(DMR) 


5. 


Class name selection 


Evaluation of semantic 
classes (EMC) 


6. 


Double descriptions 


Evaluation of semantic 
units (EMU) 


7. 


Memory for word meanings 


Memory for ideas (MMU) 


8. 


Word grouping 


Convergent production c 
sema^xtic classes (NMC) 


9. 


Word-group naming 


Concept naming (NMU) 
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Procedure . Two testing days were used. The ability 
measures and the synonym production test were admin- 
istered on the first day. The learning materials and 
criterion measures were administered on the second day. 

The 9 pretest ability measures were arranged 
in two test booklets. The booklet which was administered 
first contained the Verbal Analogies * Double Descriptions 
Class Name Selection . Word Classification > Memory for 
Word Meanings and Wide Range Vocabulary tests all of 
which yielded machine scorable responses. After a 
short breadc, the second booklet— consisting of the 
Controlled Associations % Word Croup Naming and Word 
Grouping tests— and the synonym production tests were 
administered. 

On the second day the three sets of learning 
materials were administered. Each student worked 
through all sets. Three presentation orders were used. 
All students were asked to indicate the time it took 
them to work through each set of materials. Spaces on 
which to write beginning and ending times were placed 
on each set of materials. 

The criterion tests were administered after 
all students completed the three sets of materials. 




I 



I 



Results 

The correlations between ability measures, 
two criterion tests (synonyms production and synonym 
matching) and time spent on all three types of learning 
material were of major concern. 

Table 55 contains correlations between the 
ability tests, time measures, and the synonym matching 
test. The critical aspect is the differential relation- 
ships between the ability measures and performance on 
the criterion test for the three treatment groups. 

The evaluation tests (EMU and EMC) were more highly 
related to perfonr>iance based on the synonym and class- 
ification materials than on the definition materials. 



123 







m 




TABUS 55 

Correlations of Ability and Tiije Scores 
with Synonym Matching Perfonnance 



Ability Tests 


Type of Material 

Definition Ciassi- Synonym 

fication 


Verbal 

Analogies (CMR) 


.62«» 


. 62** 


,55«* 


Double 

Description (EMU) 


.60»« 


.65»* 


.77»« 


Class Naming (EMC) 


.31 


• 51*» 


.68»» 


Word Classi- 
fication (CMC) 


.59** 


.77«» 


.71»» 


Memory (MMU) 


.38 


.37 


.6l»» 


Vocabulary (CMU) 


.73»* 


.57« 


. 52 ** 


Controlled 
Associations (DMR) 


.53** 


.64»« 


.70»» 


Word Group 
Naming (NMU) 


.62»» 


.79«» 


.73*» 


Word Grouping (NMC) 


• 

00 

m 


.«7» 


.6l«» 


Time on Definitions 


in 

CM 

• 






Time on 
Classification 




-.m* 




Time on Synonyms 









•Significant at the .05 level 
••Significant at the .01 level 









The memory test (MMU) is more highly related to 
5©^orm^ce based on the synonym materials. Vocabulary 
\CnU) ueot predicts perform^ce based on the definition 
material. The convex. gent production tests (NMU and 
NMC) are more highly related to performance based on 
the classification and synonym materials. The time 
measures correlate differently with the criterion 
measure. The highest negative correlation Is with 
performance based on the synonyms material. 

Table 56 contains the correlations between 
the ability and time measures and performance on the 
synonym production criterion test. The obtained 
patterns of interaction are similar to those obtained 
for the synonym matching criterion. The major dif- 
ference Is the relationship between the vocabulary 
(CMU) ability measures and performance. In this case, 
vocabulary Is not a differential predictor but Is 
significantly related to achievement by all methods. 



Discussion 

The results of the study appear to support 
the ATI prediction that different methods of 
instruction involve different patterns of abilities. 

It must be noted, however, that the rank order of 
correlations for the definitions and classifications 
materials do not correspond particularly well with 
the rank orders assigned by the graduate student 
judges. The small sample size of this study makes 
detailed interpretation of the results unwarranted, 
Th<*3e results do Indicate, however, that the materials 
and procedures appear to be suitable for high school 
and college freshman students. 
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Correlations of Ability and Time Scores 
with Synonym Production Performance 






Type of Material 




Ability Tests 


Definition 


Classi- 

fication 


Synonym 


1 

i 


Verbal 

Analogies (CMR) 


• 55*» 


• 45» 


.47 


1 

1 

M 


Double 

Description (EMU) 


.37 


• 50»« 


i 

.67»* 1 


1 


Class Naming (EMC) 


.16 


m 

O 

.sr 

. 


.62«» 


1 


Word Classi- 
fication (CMC) 


. 54«» 


.70»* 


.67** 




Memory (MMU) 


.46* 


.49»» 


.51** 


1 


Vocabulai?y (CMU) 


,6o«» 


.55»« 


.55»» 


1 


Controlled 
Associations (DMR) 


.57»» 


.62»« 


.61** 


1 


Word Group 
Naming (NMU) 


.59*» 


.81»* 


.63»» 


H ' 


Word Grouping (NMC) 


.59*» 


.46* 


.60** 




Time on Definitions 


.22 






1 


Time on 
Classification 




-.41* 




1 


Time on Synonyms 






_.66»* 


II 

fli 


•Significant at the 


.05 level 






1 


♦•Significant at the 


.01 level 






1 

1 

u ^ 
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C. An Investigation of Three Methods 
of Learning Vocabulary Words 

The purpose of this study was to determine 
whether differential patterns of correlations exist 
between a set of nine ability measures and achieve- 
ment under three methods for learning vocabulary words* 
The nine ability measures, the Instructional materials 
and the criterion measures were the same as those 
employed In the previous study. 



Method 



Subjects. The subJec-'-5 were 164 college freshmen. ' 
The sample Included approximately equal numbers of 
males and females. 



pterlals. The materials and the procedures for admin- 
istering them were identical to those of the previous 
study. Complete sets of materials and criterion test 
are shown in Appendix C. 



Results 

Descriptive results for the ability measures 
are presented first. Table 57 gives the means and 
standard deviations of the 164 students on the nine 
ability measures and Table 58 presents the inter- 
correlations of the nine variables. 



Because it was consistently found that average 
pretest performance was near zero, only posttest scores 
were considered in the analysis. Table 59 contains 
the means and standard deviations of the time and 
criterion measures for the group. 
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Means and Standard Deviations of the 
Nine Ability Tests 



■jj 







Test 


M 


SD 


Ver'bal Analogies 


16.54 


4.20 


Double Descriptions 


32.84 


5.31 


Class Naming 


13.71 


1.99 


Word Classification 


12.18 


2.60 


Memory for Word Meanings 


25.80 


8.75 


Wide Range Vocabulary (V- 3 ) 


11.77 


3.93 


Controlled Associations 


£.>.98 


6.70 


Word Group Naming 


18.26 


3.81 


Word Grouping 


28.07 


7.11 
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TABLE 59 



Means and Standard Deviations of the Criterion 
Tests and Average Times to Complete 
the Learning Materials 

I-1C4 







Definition 


Classi- 

fication 


Synonym 


Total 


Synonym 


M 


10.70 


11.31 


13.77 


35.78 


Matching 


SD 


4.18 


3.7^» 


2.89 


9.24 


Synonym 


M 


9.39 


7.71 


17.24 


34.34 


Production 


SD 


6.41 


5.55 


6.78 


14.56 


Time 


M 


4.80 


7.59 


6.20 


17.98 




SD 


1.64 


2.12 


1.97 


3.60 



The differential correlations between each 
ability test and the two criterion tests are of greatest 
Importance • Table 60 contains the correlations between 
the time and ability measures with synonym matching 
performance based on each type of instructional materials. 

All ability tests, except the Memory for Word 
Me^ings Test , are significantly related at the .01 
level to total synonym matching performance. The Wide 
Range Vocabulary Test is the best overall predlctor\ — 

Of interest also is the negative correlation between 
total time and total achievement. Although almost all 
tests show differential predictions with achievement 
based on the different types of material, only some 
of the more Interesting comparisons are mentioned here. 




TABLE 60 



Correlations of Ability and Time Scores 
with Synonym Matohing Performance 







Type of Material 




Ability Tests 


Defini- 

tion 


Classi- 

fication 


Synonym 


Total 


Verbal 

Analogies (CMR) 


.17« 


.26«« 


.28** 


.27** 


Double 

Description (EMU) 


.14 


.23»» 


.23** 


.24** 


Class Naming (SMC) 


.21»« 


.29** 


.20** 


.28** 


Word Classi- 
fication (CMC) 


.19* 


.18* 


.13 


.21** 


Memory (MMD) 


.00 


.04 


1 

0 

o 

VO 


.01 


Vocabulary V-3 
(CMU) 


.47»» 


.57»* 


.45»» 


.58** 


Controlled 
Associations (DMH) 


.28»* 


. .38** 


.2k** 


.35** 


Word Group 
Naming (NMU) 


.23»» 


.29** 


.18* 


.27** 


Word Grouping (NMC) 


.16» 


.19* 


.17» 


.21** 


Time on 
Definitions 


«00 








Time on 
Classification 




.01 






Time on Synonyms 






-.37*» 




Total Time 








-.21** 



^Significant at the .05 level 
^•Significant at the .01 level 
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Verbal Analogies ^ although related to performance on 
all three sets of material, is more highly related to 
the classification and synonym methods than to definl- 
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the classification and synonym material students are 
likely to have to think in terms of how sentences or 
synonyms are alike. This kind of thought could very 
well Involve the cognition of semantic relations. 

The definitions materials, on the other hand, would 
appear to depend to a lesser extent on this ability. 
Double Descriptions , an evaluation test, predicts 
performance based on clrsslfl cation and synonym 
materials but not performance based on definition 
materials. This is reasonable because In the definition 
method the definitions are stated and examples are 
given — therefore, they call for less of a cognitive 
evaluation process. Word Classification , a test of 
ability to recognize common properties of words, ideas, 
etc., does not relate to the criterion in the expetsted 
manner. It was believed to be more highly related to 
classification and synonym materials than definition 
materials. Memory for Word Meanings Is not related 
to performance based on any matierlals . The Wide Range 
Vocabulary Test is highly related to performance bifsed 
on all types of material. Thesia associations were 
expected because all the tasks are vocabulary learning. 
The Controlled Associations and Word Group Naming 
tests, being measures of production factors, ere more 
highly related to performances based on definition and 
classification materials than the synonym method. 

This was expected because few or no synonyms are 
presented in either of these materials. However, the 
Word Grouping test did not conform to these expect- 
at Ions although it is also a measure of a production 
factor. 

Table 6l presents the correlations between 
the time and ability measures with posttest synonym 
production achievement on each of the three types of 
vocabulary materials. Again all the ability tests 
except Memor^y for Word Meanings are significantly 
related at .01 level to total criterion performance 
with Wide Range Vocabulary being the best overall 
predictor. 
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Corrolatlors of Ability and Tine Seorea with 

SynoMyrn Pyndisftf.^ 

N-164 



Ability Tests 


Defini- 

tion 


Type of Material 

Class!- Synonym 
fication 


Total 


Verbal 

Analogies (CMR) 


.20»« 


.35». 


.20»* 


.3i.» 


Double 

Description (EMU) 


.17* 


.17» 


.23»* 




Class Naming (EMC) 


.1^» 


.17* 


.20«» 


.21«* 


Word Classi- 
fication (CMC) 


.13 


• 28»» 


.15 


.23». 


Memory (MMU) 


.10 


.16» 


.00 


.10 


Vocabulary V-3 
(CMU) 


.47»» 


.k3** 


.37»» 




Controlled 
Associations (DMR) 




.28*« 


.30»» 


.A3*» 


Word Group 
Naming (NMU) 


.19» 


.23** 


.22»» 


.27». 


Word Grouping (KMC) 


,30«« 


.27»« 


.16» 


.30»* 


Time on Definitions 


o 

o 

e 








Time on 
Classification 




-.16* 






Time on Synonyms 






-.29«» 




Total Time 








_.27«* 



*Slgnlf leant at the <05 level 

**Slgnif leant at the .01 level 
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The same general pattern of correlations with 
the synonym production criterion test was obtained as 
with the synonym matching test except for the following 
differences. Class Naming is significantly related 
to performance on the classification and synonym 
materials but not to performance on the definition 
material. Controlled Associations is more highly 
related to the definition material than was found with 
the synonym matching test. This again would be pred- 
icated, especially idien the criterion test requires 
the students to produce synonyms which were not available 
in the learning material. Word Grouping , although 
significantly related to all materials on the matching 
test, is more highly related when the criterion test 
is production in nature. 



Discussion 

The results of the study generally support the 
ATI theory but they are not consistent with the Judge- 
ments of graduate students nor are they always consistent 
with expectations based on logical or theoretical 
considerations. For exang)le, one might hypothesize 
that achievement of the synonym materials would be 
more dependent on short term memory than achievement 
of either definitions or classification materials 
regardless of the criterion used. The findings of the 
pilot study were consistent with this conjecture but 
the major study failed to corroborate it. Instead, 
achievement of classifications material, when the 
criterion test was synonym production, was the only 
measure related to memory. It is possible that the 
memory test, of memory for semantic units, was not 
as appropriate as a test of memory for semantic 
classes might have been. 

Each of the nine ability measures appears to 
be involved in one or more aptitude treatment inter- 
actions although formal tests of significance of 
differences between correlations were not made. 

Future studies of ATI effects with these kinds of 
materials should use criterion measures that do not 
favor one group and should employ regression analysis 
procedures. 
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D. Two Methods of Vocabulary Learning 
at Different Stages of Practice 



The purpose of this study was to determine 
whether different patterns of correlations of ability 
tests and achievement under two methods of learning 
vocabulary words would be modified by practice with 
the Instructional method* Fleishman and his associates 
(19, 20, 21) and Kohfleld (33) have shown differential 
relationships between ability measures and psychomoter 
performance at different stages of practice. Recently 
Bunder son (8) and Dunham, Guilford and Hoepfner (14) 
have also shown differential relationships between 
SI factors and performance on non-psychomoter labor- 
atory tasks at different stages of practice. In all 
of these studies the task that was practiced did not 
change. In the present study different words were 
learned at each practice stage with only the method of 
learning being constant. In this respect the present 
study resembles the work of Harlow (30) on learning 
sets more than the studies previously cited. It should 
be pointed out that the research which Is reported 
here is a pilot investigation and, like most try-outs, 
contains many flaws. A larger more comprehensive study 
is planned for the near future but will not be done In 
time to report here. 



Method 



Subl gets . Subjects for this study were two classes 
of 11th grade English students. An average ability- 
level group was used for the synonym material and an 
honors section was used for the definitions material. 
Conditions over which the Investigators had no control 
prevented them from forming groups randomly. 



Materials . Two sets of instructional materials on 
vocabulary were developed, definitions and synonyms . 
Each Is discussed below. Both sets have in common 
forty vocabulary words which were selected from the 
Thorndlke-Lorge (42) handbook. 
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B6c&u 8@ dl^flcul't wo 2 *ds with which none or fow students 
would have familiarity were desired « every word was 
taken from the lowest frequency count category. However 
no word was selected unless there were six synonyms for 



The synonym method materials were learned by 
inductive presentation. Each set of these materials 
contained four words to be learned. The four words 
were at the top of each page and wer^ followed by a 
list of five other words. Four of t lese words were 
synonyms to the key learning words and one word was 
not m appropriate synonym. A blank space was placed 
beside each s 3 fnonym and the students wrote in It what 
they thought to be the word which matched the synon^nn. 
The word "none” was written next to the extra word. 

The correct answers were on the back of the page. Each 
set of four vocabulary words contained six pages as 
described above-»every page utilized a different set 
of synonyms for the four vocabulary words ^ Ten 
different sets were constructed. 

deflnltloj fl material » the same 10 sets 
of vocabulary words were'^used. The definitions for 
each of the four words within a set were written out. 
Each word was defined In a specific way In the first 
sente ice and It was followed by a more general state- 
ment of the definition In a second sentence. A blank 
space was provided following both sentences » In which 
the student was to re-wrlte the definitions in his 
words. The criterion measure for each set of materials 
for both groups was a synonym production test. Complete 
sets of materials and a sample criterion test are shown 
In Appendix C. 



The reference battery consisted of tests 
representing eight factors postulated by the SI model. 
Because the materials were essentially the same as for 
the other vocabulary studies, the battery of tests 
was similar. Some additional tests were Included and 
some deleted on the recommendation of Dr. Ralph Hoepfner 
of the Aptitudes Research Project, University of 
Southern California. Table 62 contains the ability 
tests, the factors they are intended to measure, and 
the SI code label. 
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Procedure !. The procedure used In the present study 
was sli&jLlar to that used In the studies previously 
reported In this section. The reference battery was 
given first followed by the learning materials. The 
major difference was that the learning materials 
extended over a longer period of time. There were 
ten sets of material (both definitions and synonyms) 
with four different words in each set, one set was 
given each day for ten days. 

On the first day following the administration 
Ox the Ability tests ^ the Tlrst set of vocebuldry words 
was given. During the first few days students were 
given a pretest before receiving the learning materials 
but this was abandoned because very few of them knew 
the meanings of any of the words. Subsequently only the 
synonym p roduction posttest was administered immediately 
after the materials were finished. 

The times at which each student started and 
completed the set of materials were noted. When every- 
one had completed the materials » the posttest was 

given. Three minutes of working time were allowed for 
It# • 

Originally it was planned to give students who 
used the definition material a posttest requiring them 
to write definitions and the synonym students a post- 
test requiring them to write synonyms. However, 
because the procedure for scoring the defintllons 
resulted in very little variability, ■isMw.^nts using 
the definitions material were swltchrc. the same 
synonym production criterion postte^t m synonym 
group used. 

Because some students had excessive absences, 
the analysis is based on 25 students in the synonym 
group and 15 in the definition group. Because tine 
and posttest measures were obtained for each student 
on each of 10 days, a total of twenty scores were 
available. In several cases, if one data entry was 
not available (e.g. - a student failed to record his 
final time) the mean score for the other nine scores 
was entered. However, this procedure was used only 
if one or two data entries was missing. Students with 
more than two missing data points were eliminated from 
the analysis. 
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Results 



Per each student scores were obtained from 

elffht AhlTlltV 'f'.iaaf'.Cl . f'.'fTttA f;n \>V^a n 

w — ^4/ ^ ^ ^ ^ ^ ^ w WW 

materials, and posttest achievement In the synonym 
production test. Performance on each of the ability 
tests was correlated with both the synonym production 
test and time at each of the ten stages of practice. 

Table 63 contains the means and standard 



TABLE 63 



Means and Standard Deviations for the Two English 
Classes on Eight Ability Tests Used In the 
Vocabulary Practice Stage Study 



Tests 


Average Class 
N SD 


Honors 

m" 


Class 

SO 


Wide Range Vocabulary 


9.48 


3.07 


14.80 


3.31 


Word Classification 


9.64 


2.35 


11.67 


2.68 


Memory for Ideas 


25.28 


7.27 


35.07 


8.02 


Classified 

Information 


35.76 


6.75 


45.53 


7.14 


Topics Tests 


21.20 


5.19 


26.00 


7.12 


Utility Test 


11.86 


6.57 


15.13 


6.38 


Word-Group Naming 


16.68 


3.40 


20.13 


2.22 


Word Grouping 


26.04 


4.74 


31.80 


7.05 



deviations of the two classes on the eight ability 
tests. The results Indicate that the honors class Is 
consistently superior to the average class. Because 



I 

I 

I 

I 
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comparlsoris of patterns of correlations rather than 
mean criterion performances are of major interest in 
this study the inequality of the two groups might not 
completely invalidate the study. 

Table 64 presents the means and standard 

TABLE 64 

Means and Standard Deviations for the Synonym and 
Definition Groups on the Time and Synonym 
Production Measures for Ten Days 



Achievement 

Synonym Definition 



Time 

Synonym Definition 



1 

Day 


M 


SD 


M 


SD 


M 


SD 


M 


SD 


1 


12.52 


3.97 


• ' 


• 


8.48 


1.68 


3.67 


1.30 


B 


I6.ll8 


4.84 


• 


* 


7.40 


1.90 


4.00 


1.67 


® 3 


15.36 


4.38 


o 

CO 

ft 

CA 


2.76 


6.84 


1.74 


4.20 


.98 


1 


14.76 


5.44 


9.53 


1.89 


6.68 


2.24 


3.53 


1.45 


5 


13.92 


CM 

GO 

• 

in 


11.00 


3.26 


8.16 


1.97 


4.20 


1.38 


1 6 


12.12 


5.45 


9.46 


2.47 


6.32 


1.95 


4.13 


.88 


1 ^ 


10.76 


4.55 


9.60 


2.06 


8.40 


1.72 


3.80 


.91 


■ 8 


13.32 


5.07 


9.73 


1.95 


7.00 


2.04 


o 

oo 


1.56 


I ' 


15.84 


4.58 


13.06 


2.29 


5.80 


1.79 


3.60 


1.08 


10 


11.56 


4.92 


6.66 


1.85 


7.80 


1.82 


3.60 


• 

00 

OO 
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deviations for both the raynonym and definition groups 
on the time and synonym production posttest measures. 
Inspection of the average achievement scores reveals 
no tendency for the development of a learning set. 

**w wvato4.obcxit« pei&i^ern or improvement through- 
out the ten days Is evident. If anything, the synonym 
group tends to get worse, whereas the definition group 
seems to do equally well on all days, except the last 
These results might simply be a reflection of 
the differences between the materials on each day even 
though vocabulary words were randomly assigned. The 
again show the same relative trends. The 
aei^nltlon material, however, takes considerably less 
time to complete than the synonym material. 



Table 65 presents the correlations between 
the memory (MMV and MMC) tests and posttest achievement. 



TABLE 65 

.Correlations Between The Memory Tests 
and Posttest Achievement 



Days 


Synonym 
BMU“ MMC 


Definition 
MMtl FffiC 


1 


.32 


.29 


a 


a 


2 


.54»« 


.4l» 


a 


a 


3 


.42* 


.33 


.06 


.05 


4 


.51^^* 


.4l» 


-.25 


-.16 


5 


.32 


.48* 


.44 


.37 


6 


-.27 


.13 


-.25 


-.40 


7 


.33 


.30 


.18 


.18 


8 


.48» 


.33 


-.20 


-.09 


9 


.26 


.31 


.18 


.51» 


10 


.31 


.15 


.16 


.05 



Correlations ommltted because of different posttest 
Significant at the .0^ level 



Significant at the .01 level 

lAl 






y 






xri the synonym groups memory is significantiy related 
to achievement during the first stages of practice and 
then tends to become less Important. In the definition 
group, the only significant correlation is found during 
the ninth practice day. There does seem to be an 
increasing trend In Importance of the memory tests in 

predicting postcest performance in the definition 
group. 

Table 66 presents the correlations between the 

TABLE 66 

Correlations Between the Cognition Tests 
and Posttest Achievement 



Days 


Synonvm 
CMU CMC 


Definition 
CMa ■ cm6 


1 


.21 


-.20 


a 


a 


2 


-.03 


.22 


a 


a 


3 


.01 


.18 


.53* 


.17 


4 


-.11 


.02 


.05 


-.11 


5 


.26 


-.17 


.01 


.00 


6 


.09 


.00 


-.18 


.27 


7 


-.03 


.01 


.27 


.04 


8 


.12 


.00 


.17 


.28 


9 


.07 


.15 


-.02 


.44 


10 


.16 


.13 


.12 


.06 



Correlations omitted because of different criterion 
posttest 



Significant at the .05 level 

m2 
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cognition tests (CMV and CMC) and posttest achievement, 
in the synonym group no significant correlations were 
?? any stage of practice although there seemed 
to be a slight increasinr trend. In the definition 
groups only one significant correlation was found, 
that being on their first day. 

67 presents the correlation between the 
divergent production tests (DMU and DMC) and posttest 

TABLE 67 

Correlations Between the Divergent Production 
Tests and Posttest Achievement 



Days 



Synonym 
DMU DMC 



Definition 
DMU DMC 



1 


.29 


-.14 


a 


a 




2 


.45» 


-.06 


a 


a 




3 


1 . im m 


• 17 


.01 


-.45 




4 


.5i«« 


.09 


-.30 


.04 


Ip 


5 


.14 


.27 


.47 


.22 


p 


6 


-.34 


-.19 


-.24 


-•05 


V; 

•>*< 


7 


.57** 


.14 


.11 


-0I8 




8 


.63« 


• 31 


-.09 


.09 


S' 


9 


.29 


.04 


.28 


1 

.46 


1^1 


10 


.70«« 


.32 


-.27 


-.25 





« 

«« 



Correlations omitted because of different criterion 
posttest 

Significant at the .05 level 
Significant at the .01 level 

1^13 
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achievemeni*. . In the synonym groups, the divergent 
production tests have significant correlations throuch- 
ouc the practice stages* In addition the correlations 
tend to be.come larger through time. In the definition 
groups, no significant correlations were found. 

Table 68 presents the correlations between the 
convergent production tests (NMU and NMC) and posttest 

TABLE 58 

Correlations Between the Convergent Production 
Tests and Pcsttest Achievement 



Days 


Synonym 
NMU NMC 


Definition 
USD HHIT 




1 


.21 


.27 


a 


a 




2 


.01 


.34 


a 


a 




3 


.20 


.51«« 


.23 


-.37 




i* 


-.07 


.26 


-.41 


-.14 




5 


.16 


.08 


.19 


-.19 




6 


.08 


-.26 


.21 


.03 




7 


-.01 


.02 


-.16 


.12 




8 


.25 


.16 


-.05 


.21 




9 


-.08 


.13 


.01 


-.30 




10 


.28 


.32 


-.51 

< 


.18 








a Correlations omitted because of different criterion 
posttest 

* Significant at the ,05 level 

** Significant at the .01 level 



